2024-09-18T10:19:48.770 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T10:19:48.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T10:19:48.872 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874 branch: wip-bharath11-testing-2024-09-18-1115-quincy description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} email: skanta@redhat.com first_in_suite: false job_id: '7910874' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath11-testing-2024-09-18-1115-quincy ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 2500 ms tcp read timeout: 5 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug reject backfill probability: 0.1 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - slow request - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - mons down - mon down - out of quorum sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath11-testing-2024-09-18-1115-quincy sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 4631 sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath11-testing-2024-09-18-1115-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxCE53DzQwTYVEmzRl7NtfuHSyL6PYoCpDs67qkH9u67k/COSvcyocsQLF7U3ctK0JbVdRAfxRFbBA72W0V+Dc= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJR8YFs7eet7ZaGZgESEGqVtNwxhUzZ8cziJ+D8/VJECh+SLLEewcYc5qk0HOWzszM5d/tYPF99ZG6U4R7RFZc4= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpXkQBZfUu/tPgGv2rCxFisGeDKCexoFBRhNasJL64XYuI29uJdTh71yE/h7sitYE9RcHDaYkCoJChhBtKCSMs= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWYqABTWYtnEjq/0XqXEVfJTEgt/zSY27G3cFSrTkhxT6m74j8Fvb0Vj/UBChx5EjIzq6jSz4BwTNE810DurVw= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: bluestore_new_sharding: random chance_bluestore_reshard: 1 chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 8 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: c: 2 crush-failure-domain: osd k: 4 m: 3 name: shecprofile plugin: shec objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_09:13:00 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-18T10:19:48.872 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa; will attempt to use it 2024-09-18T10:19:48.873 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa/tasks 2024-09-18T10:19:48.873 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T10:19:48.874 INFO:teuthology.task.internal:Checking packages... 2024-09-18T10:19:48.897 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7061ea6ca50908d104e9f3979dc615e118d9e153' 2024-09-18T10:19:48.897 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T10:19:48.897 INFO:teuthology.packaging:ref: None 2024-09-18T10:19:48.897 INFO:teuthology.packaging:tag: None 2024-09-18T10:19:48.897 INFO:teuthology.packaging:branch: wip-bharath11-testing-2024-09-18-1115-quincy 2024-09-18T10:19:48.897 INFO:teuthology.packaging:sha1: 7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:19:48.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath11-testing-2024-09-18-1115-quincy 2024-09-18T10:19:49.037 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1645.g7061ea6c 2024-09-18T10:19:49.039 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T10:19:49.045 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T10:19:49.045 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T10:19:49.053 INFO:teuthology.task.internal:Saving configuration 2024-09-18T10:19:49.068 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T10:19:49.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T10:19:49.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 10:14:43.075421', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxCE53DzQwTYVEmzRl7NtfuHSyL6PYoCpDs67qkH9u67k/COSvcyocsQLF7U3ctK0JbVdRAfxRFbBA72W0V+Dc='} 2024-09-18T10:19:49.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 10:14:43.070405', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJR8YFs7eet7ZaGZgESEGqVtNwxhUzZ8cziJ+D8/VJECh+SLLEewcYc5qk0HOWzszM5d/tYPF99ZG6U4R7RFZc4='} 2024-09-18T10:19:49.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 10:14:43.073433', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpXkQBZfUu/tPgGv2rCxFisGeDKCexoFBRhNasJL64XYuI29uJdTh71yE/h7sitYE9RcHDaYkCoJChhBtKCSMs='} 2024-09-18T10:19:49.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 10:14:43.074458', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWYqABTWYtnEjq/0XqXEVfJTEgt/zSY27G3cFSrTkhxT6m74j8Fvb0Vj/UBChx5EjIzq6jSz4BwTNE810DurVw='} 2024-09-18T10:19:49.157 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T10:19:49.163 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-09-18T10:19:49.163 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-09-18T10:19:49.164 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-09-18T10:19:49.164 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-09-18T10:19:49.164 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T10:19:49.265 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc7543fac0>, signals=[15]) 2024-09-18T10:19:49.265 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T10:19:49.271 INFO:teuthology.task.internal:Opening connections... 2024-09-18T10:19:49.271 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:19:49.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:19:49.350 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:19:49.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:19:49.424 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:19:49.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:19:49.501 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:19:49.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:19:49.575 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T10:19:49.582 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-18T10:19:49.600 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-18T10:19:49.600 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-18T10:19:49.657 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-18T10:19:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T10:19:49.659 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T10:19:49.659 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T10:19:49.659 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-18T10:19:49.679 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-18T10:19:49.698 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-18T10:19:49.698 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T10:19:49.756 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-18T10:19:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-18T10:19:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T10:19:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-18T10:19:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T10:19:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T10:19:49.757 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T10:19:49.757 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-18T10:19:49.780 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-18T10:19:49.798 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-18T10:19:49.798 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-18T10:19:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-18T10:19:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-18T10:19:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-18T10:19:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-18T10:19:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-18T10:19:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T10:19:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T10:19:49.858 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-18T10:19:49.879 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-09-18T10:19:49.898 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-09-18T10:19:49.898 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-09-18T10:19:49.956 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-09-18T10:19:49.956 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-09-18T10:19:49.956 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-09-18T10:19:49.956 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T10:19:49.957 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T10:19:49.958 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-09-18T10:19:49.979 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T10:19:49.991 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T10:19:50.042 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T10:19:50.042 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-18T10:19:50.045 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-18T10:19:50.047 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-18T10:19:50.049 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-09-18T10:19:50.066 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T10:19:50.072 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T10:19:50.072 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-18T10:19:50.102 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-18T10:19:50.104 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-18T10:19:50.107 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-09-18T10:19:50.217 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T10:19:50.318 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T10:19:50.333 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T10:19:50.333 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T10:19:50.333 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T10:19:50.333 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T10:19:50.334 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T10:19:50.334 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T10:19:50.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:19:50.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:19:50.353 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-18T10:19:50.353 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-18T10:19:50.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:19:50.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:19:50.355 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-18T10:19:50.355 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-18T10:19:50.409 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-18T10:19:50.410 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-503.el9.x86_64 2024-09-18T10:19:50.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-09-18T10:19:50.411 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-18T10:19:50.411 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-18T10:19:50.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-18T10:19:50.412 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-503.el9.x86_64 2024-09-18T10:19:50.412 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-503.el9.x86_64 2024-09-18T10:19:50.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-09-18T10:19:50.413 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-503.el9.x86_64 2024-09-18T10:19:50.413 INFO:teuthology.task.kernel:Running kernel on smithi160: 5.14.0-503.el9.x86_64 2024-09-18T10:19:50.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2024-09-18T10:19:52.686 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-18T10:19:53.337 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.3 MB 00:01 2024-09-18T10:19:53.414 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.3 MB 00:01 2024-09-18T10:19:53.506 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.3 MB 00:01 2024-09-18T10:19:54.654 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-18T10:19:57.365 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-18T10:19:57.924 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-18T10:19:59.171 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-18T10:19:59.846 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-18T10:20:01.364 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-18T10:20:01.657 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-18T10:20:02.876 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-18T10:20:03.338 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-18T10:20:03.390 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-18T10:20:03.399 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-18T10:20:04.579 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-18T10:20:04.839 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-18T10:20:05.044 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-18T10:20:06.293 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-18T10:20:06.412 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-18T10:20:08.290 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-18T10:20:10.163 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T10:20:10.163 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T10:20:10.260 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:20:10.272 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T10:20:10.273 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:20:10.274 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:20:10.274 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:20:10.274 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-18T10:20:10.274 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:20:10.275 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 79 M 2024-09-18T10:20:10.275 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 126 M 2024-09-18T10:20:10.275 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:20:10.276 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-18T10:20:10.508 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 326 kB/s | 36 kB 00:00 2024-09-18T10:20:10.892 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-18T10:20:11.284 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-18T10:20:11.609 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-18T10:20:11.609 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:20:11.609 INFO:teuthology.orchestra.run.smithi071.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-18T10:20:11.724 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-18T10:20:11.842 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-18T10:20:12.016 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:01 ago on Wed 18 Sep 2024 10:20:11 AM UTC. 2024-09-18T10:20:12.183 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T10:20:12.183 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T10:20:12.282 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T10:20:12.289 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:20:12.290 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 79 M 2024-09-18T10:20:12.291 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 126 M 2024-09-18T10:20:12.291 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:20:12.292 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:20:12.647 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:20:12.647 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:20:13.178 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 57 kB/s | 36 kB 00:00 2024-09-18T10:20:13.572 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T10:20:13.572 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T10:20:13.586 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:20:13.587 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:20:13.668 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:20:13.674 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:20:13.674 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-18T10:20:13.674 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-18T10:20:13.675 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:20:13.676 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-18T10:20:13.676 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-18T10:20:13.676 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:20:13.724 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T10:20:13.724 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T10:20:13.806 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:20:13.811 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:20:13.811 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-09-18T10:20:13.811 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:20:13.811 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-09-18T10:20:13.812 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:20:13.813 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 79 M 2024-09-18T10:20:13.813 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 126 M 2024-09-18T10:20:13.813 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:20:13.986 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 290 kB/s | 36 kB 00:00 2024-09-18T10:20:14.034 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 336 kB/s | 36 kB 00:00 2024-09-18T10:20:14.070 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-18T10:20:14.334 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-18T10:20:14.795 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-18T10:20:14.834 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-18T10:20:15.160 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-18T10:20:15.160 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:20:15.160 INFO:teuthology.orchestra.run.smithi100.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-18T10:20:15.495 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-18T10:20:15.495 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:20:15.496 INFO:teuthology.orchestra.run.smithi063.stdout:Total 25 MB/s | 79 MB 00:03 2024-09-18T10:20:15.843 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:20:16.007 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:20:16.208 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:20:16.211 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:20:16.212 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:20:16.581 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:20:16.581 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:20:16.736 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:20:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:20:17.557 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:20:17.558 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:20:19.556 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:19.611 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:20:19.691 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:20.113 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:20:20.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:20:20.352 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:20.401 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.4 MB/s | 16 MB 00:06 2024-09-18T10:20:20.784 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:20:20.872 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:23.095 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:23.240 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:23.605 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:23.741 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:27.160 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-18T10:20:28.060 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:28.165 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:28.879 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:28.926 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:29.402 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:29.618 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 35 MB 00:15 2024-09-18T10:20:29.619 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:20:29.619 INFO:teuthology.orchestra.run.smithi160.stdout:Total 5.0 MB/s | 79 MB 00:15 2024-09-18T10:20:30.302 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:20:30.663 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:20:30.663 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:20:31.638 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:20:31.639 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:20:33.009 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:34.081 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:20:34.745 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:20:34.835 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:37.608 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:20:37.738 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:42.548 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:20:42.587 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:20:47.535 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:07.589 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:07.629 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:07.990 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:21:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:21:07.991 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:21:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:21:08.857 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:21:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T10:21:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:21:08.858 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:21:09.225 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:09.308 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:09.309 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:09.309 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T10:21:09.310 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T10:21:09.310 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T10:21:09.310 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-18T10:21:09.310 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T10:21:09.310 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:09.368 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:09.369 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:09.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 82.el9 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8274670 2024-09-18T10:21:09.404 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T10:21:09.405 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T10:21:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T10:21:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-09-18T10:21:09.406 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:21:09.406 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T10:21:09.407 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T10:21:09.407 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-508.el9.x86_64 2024-09-18T10:21:09.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T10:21:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-18T10:21:11.447 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:11.485 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T10:21:11.486 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:11.524 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-18T10:21:11.530 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-18T10:21:11.546 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.e5kt1v6460 2024-09-18T10:21:11.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.e5kt1v6460 2024-09-18T10:21:11.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.e5kt1v6460 2024-09-18T10:21:11.759 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.e5kt1v6460 is 6KB 2024-09-18T10:21:11.807 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.e5kt1v6460 2024-09-18T10:21:11.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T10:21:11.885 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T10:21:11.885 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T10:21:11.885 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T10:21:11.885 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T10:21:11.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T10:21:11.894 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:11.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:21:11.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:21:11.894 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:21:12.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-18T10:21:12.702 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:21:12.703 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:21:13.034 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:13.091 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:13.121 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:13.121 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:13.121 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T10:21:13.121 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T10:21:13.121 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T10:21:13.121 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-18T10:21:13.121 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T10:21:13.121 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:13.132 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:13.180 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:13.180 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:13.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-18T10:21:13.212 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-18T10:21:13.212 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-18T10:21:13.212 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-18T10:21:13.213 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:21:13.214 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T10:21:13.215 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T10:21:13.215 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-508.el9.x86_64 2024-09-18T10:21:13.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T10:21:13.414 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:13.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:21:13.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:21:13.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:21:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-18T10:21:14.258 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:21:14.259 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:21:14.600 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:14.676 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:14.677 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:14.677 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T10:21:14.677 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T10:21:14.677 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T10:21:14.677 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-18T10:21:14.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T10:21:14.677 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:14.736 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:14.736 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:14.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T10:21:14.768 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:21:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T10:21:14.770 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T10:21:14.770 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-508.el9.x86_64 2024-09-18T10:21:14.770 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T10:21:15.243 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T10:21:15.276 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-18T10:21:15.278 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-18T10:21:15.294 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.c5y8Cracil 2024-09-18T10:21:15.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.c5y8Cracil 2024-09-18T10:21:15.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.c5y8Cracil 2024-09-18T10:21:15.449 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-18T10:21:15.518 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.c5y8Cracil is 6KB 2024-09-18T10:21:15.567 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.c5y8Cracil 2024-09-18T10:21:15.581 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T10:21:15.644 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T10:21:15.644 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T10:21:15.644 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T10:21:15.644 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T10:21:15.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T10:21:15.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-18T10:21:16.837 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T10:21:16.857 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-18T10:21:16.859 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.QH5EQlv7DL 2024-09-18T10:21:16.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QH5EQlv7DL 2024-09-18T10:21:16.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.QH5EQlv7DL 2024-09-18T10:21:17.076 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.QH5EQlv7DL is 6KB 2024-09-18T10:21:17.124 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.QH5EQlv7DL 2024-09-18T10:21:17.139 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T10:21:17.201 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T10:21:17.201 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T10:21:17.201 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T10:21:17.202 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T10:21:17.203 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T10:21:17.353 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-18T10:21:25.588 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:25.628 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:26.001 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:26.002 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T10:21:26.002 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T10:21:26.002 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T10:21:26.848 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T10:21:26.849 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:21:26.849 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:21:27.193 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:27.284 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:27.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:27.284 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T10:21:27.285 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T10:21:27.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T10:21:27.285 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-18T10:21:27.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T10:21:27.285 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T10:21:27.343 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T10:21:27.344 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T10:21:27.344 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-09-18T10:21:27.378 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-09-18T10:21:27.378 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-09-18T10:21:27.378 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 82.el9 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8274670 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-09-18T10:21:27.379 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:21:27.380 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T10:21:27.381 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T10:21:27.381 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.14.0-508.el9.x86_64 2024-09-18T10:21:27.381 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T10:21:28.007 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-09-18T10:21:29.365 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T10:21:29.399 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-09-18T10:21:29.401 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-18T10:21:29.417 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.fy3RMHbzZF 2024-09-18T10:21:29.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fy3RMHbzZF 2024-09-18T10:21:29.485 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.fy3RMHbzZF 2024-09-18T10:21:29.628 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.fy3RMHbzZF is 6KB 2024-09-18T10:21:29.677 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.fy3RMHbzZF 2024-09-18T10:21:29.692 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T10:21:29.756 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T10:21:29.757 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T10:21:29.757 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T10:21:29.757 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T10:21:29.758 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T10:21:29.902 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-09-18T10:21:42.041 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-18T10:21:42.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-18T10:21:42.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:21:45.805 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-18T10:21:45.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T10:21:45.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:21:47.357 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-18T10:21:47.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-18T10:21:47.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:21:59.917 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-18T10:21:59.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-18T10:21:59.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:22:22.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-18T10:22:31.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-18T10:22:31.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:22:34.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-18T10:22:42.050 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T10:22:43.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-18T10:22:43.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:22:45.809 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T10:22:49.409 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-18T10:22:51.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-18T10:22:51.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:22:51.447 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-18T10:22:51.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-18T10:22:51.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-18T10:22:51.822 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-18T10:22:51.836 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-508.el9.x86_64 2024-09-18T10:22:51.836 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T10:22:51.836 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T10:22:51.837 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T10:22:52.838 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-18T10:22:52.838 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T10:22:52.931 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-09-18T10:22:52.953 DEBUG:teuthology.parallel:result is None 2024-09-18T10:22:54.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T10:22:54.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:22:55.478 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-18T10:22:55.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T10:22:55.888 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-18T10:22:55.888 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-18T10:22:55.903 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-508.el9.x86_64 2024-09-18T10:22:55.903 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T10:22:55.903 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T10:22:55.903 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T10:22:56.904 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-18T10:22:56.905 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T10:22:56.981 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-09-18T10:22:57.005 DEBUG:teuthology.parallel:result is None 2024-09-18T10:23:01.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-18T10:23:01.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:23:01.740 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-18T10:23:02.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-18T10:23:02.137 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T10:23:02.137 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-18T10:23:02.152 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-508.el9.x86_64 2024-09-18T10:23:02.153 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T10:23:02.153 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T10:23:02.153 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T10:23:03.154 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-18T10:23:03.154 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T10:23:03.263 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-09-18T10:23:03.287 DEBUG:teuthology.parallel:result is None 2024-09-18T10:23:15.325 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-18T10:23:15.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-18T10:23:15.695 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-18T10:23:15.695 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-18T10:23:15.709 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-508.el9.x86_64 2024-09-18T10:23:15.710 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T10:23:15.710 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T10:23:15.710 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T10:23:16.710 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-18T10:23:16.711 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T10:23:16.792 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-09-18T10:23:16.818 DEBUG:teuthology.parallel:result is None 2024-09-18T10:23:16.818 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T10:23:16.826 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T10:23:16.826 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T10:23:16.829 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T10:23:16.832 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T10:23:16.835 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T10:23:16.853 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T10:23:16.859 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T10:23:16.870 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T10:23:16.870 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T10:23:16.889 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T10:23:16.891 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T10:23:16.895 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T10:23:17.202 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T10:23:17.209 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T10:23:17.209 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T10:23:17.212 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T10:23:17.214 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T10:23:17.217 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T10:23:17.242 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.243 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.245 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.251 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.255 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.257 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.261 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T10:23:17.263 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T10:23:17.270 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T10:23:17.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T10:23:17.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T10:23:17.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T10:23:17.304 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T10:23:17.329 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T10:23:17.340 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T10:23:17.340 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T10:23:17.370 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T10:23:17.372 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T10:23:17.375 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T10:23:17.390 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:17.471 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:17.519 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:17.596 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:17.646 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:23:17.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T10:23:17.713 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:17.757 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:17.812 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:17.895 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:17.941 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:23:17.941 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T10:23:18.007 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:18.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:18.114 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:18.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:18.201 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:23:18.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T10:23:18.267 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:18.303 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T10:23:18.351 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:18.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T10:23:18.471 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:23:18.471 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T10:23:18.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-18T10:23:18.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-18T10:23:18.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-18T10:23:18.543 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-09-18T10:23:18.582 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:23:18.592 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:23:18.600 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:23:18.617 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:23:19.105 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T10:23:19.113 INFO:teuthology.task.internal:Starting timer... 2024-09-18T10:23:19.113 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T10:23:19.123 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T10:23:19.132 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-18T10:23:19.176 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-18T10:23:19.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-18T10:23:19.257 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-18T10:23:19.258 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-18T10:23:19.347 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-18T10:23:19.349 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-09-18T10:23:19.393 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-09-18T10:23:19.395 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T10:23:19.395 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-18T10:23:19.441 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-18T10:23:19.441 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-18T10:23:19.469 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-18T10:23:19.469 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-18T10:23:19.489 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-18T10:23:19.490 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-09-18T10:23:19.512 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-09-18T10:23:19.512 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-09-18T10:23:19.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:23:19.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:23:19.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:23:19.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:23:19.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:23:19.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:23:19.598 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:23:19.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:23:19.624 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T10:23:19.624 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-18T10:23:19.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-18T10:23:19.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-18T10:23:19.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-09-18T10:23:19.757 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T10:23:19.767 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-18T10:23:19.770 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-18T10:23:19.887 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T10:23:19.897 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T10:23:19.898 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi071.front.sepia.ceph.com,smithi100.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T10:27:12.964 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-09-18T10:27:12.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-18T10:27:12.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:27:13.043 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-18T10:27:13.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-18T10:27:13.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-18T10:27:13.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:27:13.205 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-18T10:27:13.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-18T10:27:13.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T10:27:13.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:27:13.374 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-18T10:27:13.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-18T10:27:13.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-18T10:27:13.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T10:27:13.536 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-18T10:27:13.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-18T10:27:13.618 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T10:27:13.629 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T10:27:13.630 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T10:27:13.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:27:13.633 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T10:27:13.633 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:27:13.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T10:27:13.635 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:27:13.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T10:27:13.638 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:27:13.666 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T10:27:13.667 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T10:27:13.668 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T10:27:13.681 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T10:27:13.682 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T10:27:13.683 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T10:27:13.688 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T10:27:13.703 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T10:27:13.707 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-18T10:27:13.709 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-18T10:27:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-18T10:27:13.719 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-18T10:27:13.721 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-18T10:27:13.723 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-18T10:27:13.729 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-09-18T10:27:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T10:27:13.736 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T10:27:13.740 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-09-18T10:27:13.740 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T10:27:13.748 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T10:27:13.750 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T10:27:13.754 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T10:27:13.755 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T10:27:13.769 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T10:27:13.805 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:27:13.805 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:27:13.808 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:27:13.808 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-18T10:27:13.808 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.808 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.808 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.808 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.810 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:27:13.810 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-18T10:27:13.810 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.810 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.810 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.810 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:27:13.818 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:27:13.818 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-18T10:27:13.818 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.819 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.819 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.819 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.823 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:27:13.825 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:27:13.825 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-18T10:27:13.826 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.826 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.826 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.826 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:27:13.827 INFO:teuthology.run_tasks:Running task install... 2024-09-18T10:27:13.835 DEBUG:teuthology.task.install:project ceph 2024-09-18T10:27:13.835 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}} 2024-09-18T10:27:13.835 DEBUG:teuthology.task.install:config {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'} 2024-09-18T10:27:13.835 INFO:teuthology.task.install:Using flavor: default 2024-09-18T10:27:13.841 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T10:27:13.841 INFO:teuthology.task.install:extra packages: [] 2024-09-18T10:27:13.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo dnf -y install 'dnf-command(copr)' 2024-09-18T10:27:13.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo dnf -y install 'dnf-command(copr)' 2024-09-18T10:27:13.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo dnf -y install 'dnf-command(copr)' 2024-09-18T10:27:13.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo dnf -y install 'dnf-command(copr)' 2024-09-18T10:27:14.425 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:46 ago on Wed 18 Sep 2024 10:26:28 AM UTC. 2024-09-18T10:27:14.431 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 10:26:19 AM UTC. 2024-09-18T10:27:14.439 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 10:26:19 AM UTC. 2024-09-18T10:27:14.462 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 10:26:23 AM UTC. 2024-09-18T10:27:14.512 INFO:teuthology.orchestra.run.smithi100.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-09-18T10:27:14.518 INFO:teuthology.orchestra.run.smithi071.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-09-18T10:27:14.525 INFO:teuthology.orchestra.run.smithi160.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-09-18T10:27:14.550 INFO:teuthology.orchestra.run.smithi063.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-09-18T10:27:14.555 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:27:14.556 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:27:14.556 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:27:14.561 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:27:14.562 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:27:14.562 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:27:14.567 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:27:14.568 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:27:14.568 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:27:14.595 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:27:14.596 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:27:14.597 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:27:14.623 DEBUG:teuthology.orchestra.run.smithi100:> sudo dnf -y copr enable ceph/el9 2024-09-18T10:27:14.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo dnf -y copr enable ceph/el9 2024-09-18T10:27:14.629 DEBUG:teuthology.orchestra.run.smithi160:> sudo dnf -y copr enable ceph/el9 2024-09-18T10:27:14.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo dnf -y copr enable ceph/el9 2024-09-18T10:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-09-18T10:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr:of the main distribution, and quality may vary. 2024-09-18T10:27:14.794 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:The Fedora Project does not exercise any power over the contents of 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:, 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:and packages are not held to any quality or security level. 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:Please do not file bug reports about these packages in Fedora 2024-09-18T10:27:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:of the main distribution, and quality may vary. 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:The Fedora Project does not exercise any power over the contents of 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:, 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:and packages are not held to any quality or security level. 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-18T10:27:14.807 INFO:teuthology.orchestra.run.smithi160.stderr:Please do not file bug reports about these packages in Fedora 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi160.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:of the main distribution, and quality may vary. 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:The Fedora Project does not exercise any power over the contents of 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:, 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:and packages are not held to any quality or security level. 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-18T10:27:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:Please do not file bug reports about these packages in Fedora 2024-09-18T10:27:14.809 INFO:teuthology.orchestra.run.smithi071.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr:of the main distribution, and quality may vary. 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr:The Fedora Project does not exercise any power over the contents of 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr:, 2024-09-18T10:27:14.845 INFO:teuthology.orchestra.run.smithi063.stderr:and packages are not held to any quality or security level. 2024-09-18T10:27:14.846 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-18T10:27:14.846 INFO:teuthology.orchestra.run.smithi063.stderr:Please do not file bug reports about these packages in Fedora 2024-09-18T10:27:14.846 INFO:teuthology.orchestra.run.smithi063.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-09-18T10:27:14.846 INFO:teuthology.orchestra.run.smithi100.stdout:Repository successfully enabled. 2024-09-18T10:27:14.861 INFO:teuthology.orchestra.run.smithi071.stdout:Repository successfully enabled. 2024-09-18T10:27:14.863 INFO:teuthology.orchestra.run.smithi160.stdout:Repository successfully enabled. 2024-09-18T10:27:14.881 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'tag': None, 'wait_for_package': False} 2024-09-18T10:27:14.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:27:14.896 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'tag': None, 'wait_for_package': False} 2024-09-18T10:27:14.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:27:14.899 INFO:teuthology.orchestra.run.smithi063.stdout:Repository successfully enabled. 2024-09-18T10:27:14.901 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'tag': None, 'wait_for_package': False} 2024-09-18T10:27:14.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:27:14.940 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'tag': None, 'wait_for_package': False} 2024-09-18T10:27:14.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:27:15.023 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/ 2024-09-18T10:27:15.024 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1645.g7061ea6c 2024-09-18T10:27:15.039 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/ 2024-09-18T10:27:15.039 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1645.g7061ea6c 2024-09-18T10:27:15.045 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/ 2024-09-18T10:27:15.045 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1645.g7061ea6c 2024-09-18T10:27:15.085 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/ 2024-09-18T10:27:15.085 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1645.g7061ea6c 2024-09-18T10:27:15.134 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T10:27:15.135 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:27:15.135 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T10:27:15.150 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T10:27:15.150 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:27:15.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T10:27:15.156 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T10:27:15.156 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:27:15.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T10:27:15.160 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T10:27:15.160 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7061ea6ca50908d104e9f3979dc615e118d9e153/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T10:27:15.175 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T10:27:15.176 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7061ea6ca50908d104e9f3979dc615e118d9e153/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T10:27:15.181 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T10:27:15.181 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7061ea6ca50908d104e9f3979dc615e118d9e153/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T10:27:15.194 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-bharath11-testing-2024-09-18-1115-quincy/7061ea6ca50908d104e9f3979dc615e118d9e153/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T10:27:15.194 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:27:15.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T10:27:15.220 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T10:27:15.220 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7061ea6ca50908d104e9f3979dc615e118d9e153/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T10:27:15.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T10:27:15.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T10:27:15.248 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T10:27:15.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T10:27:15.301 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T10:27:15.315 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T10:27:15.323 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T10:27:15.364 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T10:27:15.365 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-18T10:27:15.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-18T10:27:15.379 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-18T10:27:15.380 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-18T10:27:15.387 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-09-18T10:27:15.390 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-09-18T10:27:15.428 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-18T10:27:15.430 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-18T10:27:15.599 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-18T10:27:15.611 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-18T10:27:15.620 INFO:teuthology.orchestra.run.smithi160.stdout:45 files removed 2024-09-18T10:27:15.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw 2024-09-18T10:27:15.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw 2024-09-18T10:27:15.646 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw 2024-09-18T10:27:15.670 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-18T10:27:15.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw 2024-09-18T10:27:16.177 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 286 kB/s | 77 kB 00:00 2024-09-18T10:27:16.195 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 280 kB/s | 77 kB 00:00 2024-09-18T10:27:16.199 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 289 kB/s | 77 kB 00:00 2024-09-18T10:27:16.255 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 300 kB/s | 77 kB 00:00 2024-09-18T10:27:16.453 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-18T10:27:16.474 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-18T10:27:16.479 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-18T10:27:16.664 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-09-18T10:27:16.720 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 7.8 kB/s | 1.8 kB 00:00 2024-09-18T10:27:16.733 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 8.0 kB/s | 1.8 kB 00:00 2024-09-18T10:27:16.754 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-18T10:27:16.884 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for el9 owned by ceph 66 kB/s | 7.6 kB 00:00 2024-09-18T10:27:16.896 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for el9 owned by ceph 54 kB/s | 7.6 kB 00:00 2024-09-18T10:27:16.913 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for el9 owned by ceph 62 kB/s | 7.6 kB 00:00 2024-09-18T10:27:16.940 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-18T10:27:17.107 INFO:teuthology.orchestra.run.smithi063.stdout:Copr repo for el9 owned by ceph 59 kB/s | 7.6 kB 00:00 2024-09-18T10:27:17.604 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-18T10:27:17.689 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-18T10:27:18.413 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.3 MB 00:01 2024-09-18T10:27:19.099 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-18T10:27:19.609 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-18T10:27:22.634 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 20 MB 00:02 2024-09-18T10:27:25.568 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-18T10:27:27.030 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-09-18T10:27:27.168 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-18T10:27:27.275 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-18T10:27:28.630 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-18T10:27:28.860 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-18T10:27:30.055 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-18T10:27:32.490 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-18T10:27:34.094 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-18T10:27:34.365 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-18T10:27:35.711 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-18T10:27:35.728 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-18T10:27:36.316 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-18T10:27:36.444 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:27:36.459 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:27:36.459 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:27:36.459 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 14 M 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.1 M 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 5.0 M 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 22 M 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 637 k 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T10:27:36.460 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 458 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 4.9 M 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 45 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 120 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 156 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 320 k 2024-09-18T10:27:36.461 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 296 k 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 99 k 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout:Install 22 Packages 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:27:36.462 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 58 M 2024-09-18T10:27:36.463 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:27:37.920 INFO:teuthology.orchestra.run.smithi071.stdout:(1/24): ceph-common-17.2.7-1645.g7061ea6c.el9.x 19 MB/s | 22 MB 00:01 2024-09-18T10:27:37.995 INFO:teuthology.orchestra.run.smithi071.stdout:(2/24): ceph-base-17.2.7-1645.g7061ea6c.el9.x86 4.0 MB/s | 5.0 MB 00:01 2024-09-18T10:27:38.012 INFO:teuthology.orchestra.run.smithi071.stdout:(3/24): ceph-selinux-17.2.7-1645.g7061ea6c.el9. 275 kB/s | 25 kB 00:00 2024-09-18T10:27:38.071 INFO:teuthology.orchestra.run.smithi071.stdout:(4/24): libradosstriper1-17.2.7-1645.g7061ea6c. 7.6 MB/s | 458 kB 00:00 2024-09-18T10:27:38.105 INFO:teuthology.orchestra.run.smithi071.stdout:(5/24): libcephfs2-17.2.7-1645.g7061ea6c.el9.x8 5.7 MB/s | 637 kB 00:00 2024-09-18T10:27:38.123 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 14 M 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.1 M 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 5.0 M 2024-09-18T10:27:38.126 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 22 M 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 637 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 458 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 4.9 M 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T10:27:38.127 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 45 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 120 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 156 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 320 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 296 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 99 k 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout:Install 22 Packages 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 2 Packages 2024-09-18T10:27:38.128 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:27:38.129 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 58 M 2024-09-18T10:27:38.129 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:27:38.247 INFO:teuthology.orchestra.run.smithi071.stdout:(6/24): ceph-radosgw-17.2.7-1645.g7061ea6c.el9. 9.6 MB/s | 14 MB 00:01 2024-09-18T10:27:38.263 INFO:teuthology.orchestra.run.smithi071.stdout:(7/24): python3-ceph-argparse-17.2.7-1645.g7061 285 kB/s | 45 kB 00:00 2024-09-18T10:27:38.289 INFO:teuthology.orchestra.run.smithi071.stdout:(8/24): python3-ceph-common-17.2.7-1645.g7061ea 2.8 MB/s | 120 kB 00:00 2024-09-18T10:27:38.314 INFO:teuthology.orchestra.run.smithi071.stdout:(9/24): python3-cephfs-17.2.7-1645.g7061ea6c.el 3.0 MB/s | 156 kB 00:00 2024-09-18T10:27:38.339 INFO:teuthology.orchestra.run.smithi071.stdout:(10/24): python3-rados-17.2.7-1645.g7061ea6c.el 6.2 MB/s | 320 kB 00:00 2024-09-18T10:27:38.373 INFO:teuthology.orchestra.run.smithi071.stdout:(11/24): python3-rbd-17.2.7-1645.g7061ea6c.el9. 5.0 MB/s | 296 kB 00:00 2024-09-18T10:27:38.398 INFO:teuthology.orchestra.run.smithi071.stdout:(12/24): python3-rgw-17.2.7-1645.g7061ea6c.el9. 1.7 MB/s | 99 kB 00:00 2024-09-18T10:27:38.482 INFO:teuthology.orchestra.run.smithi071.stdout:(13/24): librgw2-17.2.7-1645.g7061ea6c.el9.x86_ 12 MB/s | 4.9 MB 00:00 2024-09-18T10:27:38.598 INFO:teuthology.orchestra.run.smithi071.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2024-09-18T10:27:38.657 INFO:teuthology.orchestra.run.smithi071.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 564 kB/s | 160 kB 00:00 2024-09-18T10:27:38.699 INFO:teuthology.orchestra.run.smithi071.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-18T10:27:38.758 INFO:teuthology.orchestra.run.smithi071.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 5.2 MB/s | 308 kB 00:00 2024-09-18T10:27:38.783 INFO:teuthology.orchestra.run.smithi071.stdout:(18/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-18T10:27:38.808 INFO:teuthology.orchestra.run.smithi071.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-18T10:27:38.850 INFO:teuthology.orchestra.run.smithi071.stdout:(20/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-09-18T10:27:38.884 INFO:teuthology.orchestra.run.smithi071.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-09-18T10:27:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:(1/24): ceph-base-17.2.7-1645.g7061ea6c.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-18T10:27:38.951 INFO:teuthology.orchestra.run.smithi071.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-18T10:27:38.954 INFO:teuthology.orchestra.run.smithi063.stdout:(2/24): ceph-selinux-17.2.7-1645.g7061ea6c.el9. 379 kB/s | 25 kB 00:00 2024-09-18T10:27:39.218 INFO:teuthology.orchestra.run.smithi071.stdout:(23/24): librbd1-17.2.7-1645.g7061ea6c.el9.x86_ 8.8 MB/s | 2.9 MB 00:00 2024-09-18T10:27:39.334 INFO:teuthology.orchestra.run.smithi071.stdout:(24/24): librados2-17.2.7-1645.g7061ea6c.el9.x8 6.4 MB/s | 3.1 MB 00:00 2024-09-18T10:27:39.339 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:27:39.339 INFO:teuthology.orchestra.run.smithi071.stdout:Total 20 MB/s | 58 MB 00:02 2024-09-18T10:27:39.404 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:27:39.438 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:27:39.438 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:27:39.621 INFO:teuthology.orchestra.run.smithi063.stdout:(3/24): ceph-common-17.2.7-1645.g7061ea6c.el9.x 19 MB/s | 22 MB 00:01 2024-09-18T10:27:39.646 INFO:teuthology.orchestra.run.smithi063.stdout:(4/24): libcephfs2-17.2.7-1645.g7061ea6c.el9.x8 921 kB/s | 637 kB 00:00 2024-09-18T10:27:39.672 INFO:teuthology.orchestra.run.smithi063.stdout:(5/24): libradosstriper1-17.2.7-1645.g7061ea6c. 9.0 MB/s | 458 kB 00:00 2024-09-18T10:27:39.839 INFO:teuthology.orchestra.run.smithi063.stdout:(6/24): ceph-radosgw-17.2.7-1645.g7061ea6c.el9. 10 MB/s | 14 MB 00:01 2024-09-18T10:27:39.855 INFO:teuthology.orchestra.run.smithi063.stdout:(7/24): python3-ceph-argparse-17.2.7-1645.g7061 246 kB/s | 45 kB 00:00 2024-09-18T10:27:39.889 INFO:teuthology.orchestra.run.smithi063.stdout:(8/24): python3-ceph-common-17.2.7-1645.g7061ea 2.3 MB/s | 120 kB 00:00 2024-09-18T10:27:39.914 INFO:teuthology.orchestra.run.smithi063.stdout:(9/24): python3-cephfs-17.2.7-1645.g7061ea6c.el 2.6 MB/s | 156 kB 00:00 2024-09-18T10:27:39.940 INFO:teuthology.orchestra.run.smithi063.stdout:(10/24): python3-rados-17.2.7-1645.g7061ea6c.el 6.2 MB/s | 320 kB 00:00 2024-09-18T10:27:39.965 INFO:teuthology.orchestra.run.smithi063.stdout:(11/24): python3-rbd-17.2.7-1645.g7061ea6c.el9. 5.7 MB/s | 296 kB 00:00 2024-09-18T10:27:39.990 INFO:teuthology.orchestra.run.smithi063.stdout:(12/24): python3-rgw-17.2.7-1645.g7061ea6c.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T10:27:40.074 INFO:teuthology.orchestra.run.smithi063.stdout:(13/24): librgw2-17.2.7-1645.g7061ea6c.el9.x86_ 12 MB/s | 4.9 MB 00:00 2024-09-18T10:27:40.091 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:27:40.092 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:27:40.141 INFO:teuthology.orchestra.run.smithi063.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 913 kB/s | 160 kB 00:00 2024-09-18T10:27:40.166 INFO:teuthology.orchestra.run.smithi063.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 258 kB/s | 45 kB 00:00 2024-09-18T10:27:40.208 INFO:teuthology.orchestra.run.smithi063.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-18T10:27:40.233 INFO:teuthology.orchestra.run.smithi063.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 629 kB/s | 42 kB 00:00 2024-09-18T10:27:40.267 INFO:teuthology.orchestra.run.smithi063.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-18T10:27:40.326 INFO:teuthology.orchestra.run.smithi063.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-09-18T10:27:40.367 INFO:teuthology.orchestra.run.smithi063.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2024-09-18T10:27:40.393 INFO:teuthology.orchestra.run.smithi063.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 619 kB/s | 67 kB 00:00 2024-09-18T10:27:40.510 INFO:teuthology.orchestra.run.smithi063.stdout:(22/24): librados2-17.2.7-1645.g7061ea6c.el9.x8 22 MB/s | 3.1 MB 00:00 2024-09-18T10:27:40.552 INFO:teuthology.orchestra.run.smithi063.stdout:(23/24): thrift-0.15.0-2.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-09-18T10:27:40.602 INFO:teuthology.orchestra.run.smithi063.stdout:(24/24): librbd1-17.2.7-1645.g7061ea6c.el9.x86_ 14 MB/s | 2.9 MB 00:00 2024-09-18T10:27:40.607 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:27:40.607 INFO:teuthology.orchestra.run.smithi063.stdout:Total 23 MB/s | 58 MB 00:02 2024-09-18T10:27:40.671 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:27:40.708 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:27:40.708 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:27:40.800 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.5 MB 00:00 2024-09-18T10:27:41.117 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-18T10:27:41.306 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:27:41.338 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:27:41.339 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:27:41.648 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-18T10:27:41.761 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:41.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:27:41.963 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:42.034 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:42.080 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-18T10:27:42.110 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-18T10:27:42.193 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 117 kB/s | 19 kB 00:00 2024-09-18T10:27:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-18T10:27:42.574 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:42.587 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:27:42.637 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:42.673 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-18T10:27:42.716 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 10/26 2024-09-18T10:27:42.754 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:27:42.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:27:42.851 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:42.917 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:42.957 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-18T10:27:42.976 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-18T10:27:42.994 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-18T10:27:43.036 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-18T10:27:43.046 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:43.122 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:43.206 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:27:43.230 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:43.303 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:43.335 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-18T10:27:43.352 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-18T10:27:43.385 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-18T10:27:43.389 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:43.417 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:27:43.420 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:27:43.420 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:27:43.420 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:27:43.420 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 14 M 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.1 M 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 5.0 M 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 22 M 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 637 k 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T10:27:43.421 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 458 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 4.9 M 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 45 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 120 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 156 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 320 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 296 k 2024-09-18T10:27:43.422 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 99 k 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout:Install 22 Packages 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 2 Packages 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 58 M 2024-09-18T10:27:43.423 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:27:43.471 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-18T10:27:43.479 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:43.570 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 19/26 2024-09-18T10:27:43.600 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 20/26 2024-09-18T10:27:43.849 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-18T10:27:43.875 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:43.938 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:43.975 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-18T10:27:44.018 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 10/26 2024-09-18T10:27:44.063 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:27:44.131 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:27:44.161 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:44.226 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-18T10:27:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-18T10:27:44.336 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-18T10:27:44.468 INFO:teuthology.orchestra.run.smithi100.stdout:(1/24): ceph-base-17.2.7-1645.g7061ea6c.el9.x86 8.0 MB/s | 5.0 MB 00:00 2024-09-18T10:27:44.543 INFO:teuthology.orchestra.run.smithi100.stdout:(2/24): ceph-selinux-17.2.7-1645.g7061ea6c.el9. 335 kB/s | 25 kB 00:00 2024-09-18T10:27:44.654 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-18T10:27:44.698 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:44.710 INFO:teuthology.orchestra.run.smithi100.stdout:(3/24): ceph-radosgw-17.2.7-1645.g7061ea6c.el9. 17 MB/s | 14 MB 00:00 2024-09-18T10:27:44.743 INFO:teuthology.orchestra.run.smithi100.stdout:(4/24): libcephfs2-17.2.7-1645.g7061ea6c.el9.x8 3.1 MB/s | 637 kB 00:00 2024-09-18T10:27:44.772 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:44.777 INFO:teuthology.orchestra.run.smithi100.stdout:(5/24): libradosstriper1-17.2.7-1645.g7061ea6c. 6.7 MB/s | 458 kB 00:00 2024-09-18T10:27:44.849 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 19/26 2024-09-18T10:27:44.853 INFO:teuthology.orchestra.run.smithi100.stdout:(6/24): python3-ceph-argparse-17.2.7-1645.g7061 601 kB/s | 45 kB 00:00 2024-09-18T10:27:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 20/26 2024-09-18T10:27:44.936 INFO:teuthology.orchestra.run.smithi100.stdout:(7/24): python3-ceph-common-17.2.7-1645.g7061ea 1.4 MB/s | 120 kB 00:00 2024-09-18T10:27:45.028 INFO:teuthology.orchestra.run.smithi100.stdout:(8/24): librgw2-17.2.7-1645.g7061ea6c.el9.x86_6 17 MB/s | 4.9 MB 00:00 2024-09-18T10:27:45.053 INFO:teuthology.orchestra.run.smithi100.stdout:(9/24): python3-cephfs-17.2.7-1645.g7061ea6c.el 1.3 MB/s | 156 kB 00:00 2024-09-18T10:27:45.078 INFO:teuthology.orchestra.run.smithi100.stdout:(10/24): python3-rados-17.2.7-1645.g7061ea6c.el 6.2 MB/s | 320 kB 00:00 2024-09-18T10:27:45.113 INFO:teuthology.orchestra.run.smithi100.stdout:(11/24): python3-rbd-17.2.7-1645.g7061ea6c.el9. 4.9 MB/s | 296 kB 00:00 2024-09-18T10:27:45.138 INFO:teuthology.orchestra.run.smithi100.stdout:(12/24): python3-rgw-17.2.7-1645.g7061ea6c.el9. 1.6 MB/s | 99 kB 00:00 2024-09-18T10:27:45.347 INFO:teuthology.orchestra.run.smithi100.stdout:(13/24): ceph-common-17.2.7-1645.g7061ea6c.el9. 15 MB/s | 22 MB 00:01 2024-09-18T10:27:45.464 INFO:teuthology.orchestra.run.smithi100.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 139 kB/s | 45 kB 00:00 2024-09-18T10:27:45.522 INFO:teuthology.orchestra.run.smithi100.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 392 kB/s | 160 kB 00:00 2024-09-18T10:27:45.572 INFO:teuthology.orchestra.run.smithi100.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-18T10:27:45.614 INFO:teuthology.orchestra.run.smithi100.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-18T10:27:45.656 INFO:teuthology.orchestra.run.smithi100.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-18T10:27:45.682 INFO:teuthology.orchestra.run.smithi100.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 747 kB/s | 49 kB 00:00 2024-09-18T10:27:45.707 INFO:teuthology.orchestra.run.smithi100.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-18T10:27:45.732 INFO:teuthology.orchestra.run.smithi100.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 915 kB/s | 67 kB 00:00 2024-09-18T10:27:45.807 INFO:teuthology.orchestra.run.smithi100.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-18T10:27:45.883 INFO:teuthology.orchestra.run.smithi100.stdout:(23/24): librados2-17.2.7-1645.g7061ea6c.el9.x8 18 MB/s | 3.1 MB 00:00 2024-09-18T10:27:45.945 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:45.987 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:46.023 INFO:teuthology.orchestra.run.smithi100.stdout:(24/24): librbd1-17.2.7-1645.g7061ea6c.el9.x86_ 10 MB/s | 2.9 MB 00:00 2024-09-18T10:27:46.029 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:27:46.029 INFO:teuthology.orchestra.run.smithi100.stdout:Total 22 MB/s | 58 MB 00:02 2024-09-18T10:27:46.095 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:27:46.127 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:27:46.128 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:27:46.514 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:46.557 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:27:46.659 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:27:46.659 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T10:27:46.659 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T10:27:46.659 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:27:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:27:46.740 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:27:46.740 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:27:47.369 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:47.413 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:27:48.009 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:27:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:27:48.123 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T10:27:48.123 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T10:27:48.123 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:27:48.351 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:27:48.396 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-18T10:27:48.477 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:48.569 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:48.655 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:27:48.687 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:48.775 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:48.831 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-18T10:27:48.858 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-18T10:27:48.869 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-18T10:27:49.303 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-18T10:27:49.331 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:49.377 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:49.406 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-18T10:27:49.448 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 10/26 2024-09-18T10:27:49.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:27:49.554 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:27:49.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:49.650 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:49.702 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-18T10:27:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-18T10:27:49.776 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-18T10:27:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-18T10:27:50.105 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:50.194 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:50.268 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 19/26 2024-09-18T10:27:50.299 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 20/26 2024-09-18T10:27:51.202 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:27:51.240 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:27:51.240 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:27:51.240 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:27:51.240 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 14 M 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.1 M 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 5.0 M 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 22 M 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 637 k 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T10:27:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 458 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 4.9 M 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 45 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 120 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 156 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 320 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 296 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 99 k 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T10:27:51.242 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout:Install 22 Packages 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 2 Packages 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 58 M 2024-09-18T10:27:51.243 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:27:52.154 INFO:teuthology.orchestra.run.smithi160.stdout:(1/24): ceph-base-17.2.7-1645.g7061ea6c.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-18T10:27:52.221 INFO:teuthology.orchestra.run.smithi160.stdout:(2/24): ceph-selinux-17.2.7-1645.g7061ea6c.el9. 378 kB/s | 25 kB 00:00 2024-09-18T10:27:52.329 INFO:teuthology.orchestra.run.smithi160.stdout:(3/24): libcephfs2-17.2.7-1645.g7061ea6c.el9.x8 5.7 MB/s | 637 kB 00:00 2024-09-18T10:27:52.438 INFO:teuthology.orchestra.run.smithi160.stdout:(4/24): libradosstriper1-17.2.7-1645.g7061ea6c. 4.1 MB/s | 458 kB 00:00 2024-09-18T10:27:52.720 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:52.779 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:52.830 INFO:teuthology.orchestra.run.smithi160.stdout:(5/24): ceph-common-17.2.7-1645.g7061ea6c.el9.x 19 MB/s | 22 MB 00:01 2024-09-18T10:27:52.963 INFO:teuthology.orchestra.run.smithi160.stdout:(6/24): ceph-radosgw-17.2.7-1645.g7061ea6c.el9. 11 MB/s | 14 MB 00:01 2024-09-18T10:27:52.988 INFO:teuthology.orchestra.run.smithi160.stdout:(7/24): python3-ceph-argparse-17.2.7-1645.g7061 285 kB/s | 45 kB 00:00 2024-09-18T10:27:53.014 INFO:teuthology.orchestra.run.smithi160.stdout:(8/24): python3-ceph-common-17.2.7-1645.g7061ea 2.3 MB/s | 120 kB 00:00 2024-09-18T10:27:53.039 INFO:teuthology.orchestra.run.smithi160.stdout:(9/24): python3-cephfs-17.2.7-1645.g7061ea6c.el 3.0 MB/s | 156 kB 00:00 2024-09-18T10:27:53.064 INFO:teuthology.orchestra.run.smithi160.stdout:(10/24): python3-rados-17.2.7-1645.g7061ea6c.el 6.2 MB/s | 320 kB 00:00 2024-09-18T10:27:53.089 INFO:teuthology.orchestra.run.smithi160.stdout:(11/24): python3-rbd-17.2.7-1645.g7061ea6c.el9. 5.8 MB/s | 296 kB 00:00 2024-09-18T10:27:53.115 INFO:teuthology.orchestra.run.smithi160.stdout:(12/24): python3-rgw-17.2.7-1645.g7061ea6c.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T10:27:53.198 INFO:teuthology.orchestra.run.smithi160.stdout:(13/24): librgw2-17.2.7-1645.g7061ea6c.el9.x86_ 6.5 MB/s | 4.9 MB 00:00 2024-09-18T10:27:53.265 INFO:teuthology.orchestra.run.smithi160.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 913 kB/s | 160 kB 00:00 2024-09-18T10:27:53.291 INFO:teuthology.orchestra.run.smithi160.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 258 kB/s | 45 kB 00:00 2024-09-18T10:27:53.300 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:27:53.333 INFO:teuthology.orchestra.run.smithi160.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-18T10:27:53.340 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:27:53.358 INFO:teuthology.orchestra.run.smithi160.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-18T10:27:53.391 INFO:teuthology.orchestra.run.smithi160.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-18T10:27:53.423 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:27:53.423 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T10:27:53.424 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T10:27:53.424 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:27:53.442 INFO:teuthology.orchestra.run.smithi160.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-18T10:27:53.458 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:27:53.467 INFO:teuthology.orchestra.run.smithi160.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-18T10:27:53.492 INFO:teuthology.orchestra.run.smithi160.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 789 kB/s | 67 kB 00:00 2024-09-18T10:27:53.601 INFO:teuthology.orchestra.run.smithi160.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-18T10:27:53.651 INFO:teuthology.orchestra.run.smithi160.stdout:(23/24): librbd1-17.2.7-1645.g7061ea6c.el9.x86_ 19 MB/s | 2.9 MB 00:00 2024-09-18T10:27:53.701 INFO:teuthology.orchestra.run.smithi160.stdout:(24/24): librados2-17.2.7-1645.g7061ea6c.el9.x8 13 MB/s | 3.1 MB 00:00 2024-09-18T10:27:53.707 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:27:53.707 INFO:teuthology.orchestra.run.smithi160.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-18T10:27:53.771 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:27:53.805 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:27:53.805 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:27:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:27:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:27:55.696 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:27:56.083 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-18T10:27:56.162 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:56.253 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:56.340 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:27:56.371 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:56.459 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:56.505 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-18T10:27:56.505 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:27:56.505 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-18T10:27:56.506 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:27:56.544 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-18T10:27:56.979 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-18T10:27:57.008 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:57.071 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 8/26 2024-09-18T10:27:57.110 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-18T10:27:57.150 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 10/26 2024-09-18T10:27:57.187 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:27:57.259 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:27:57.285 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:57.352 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 13/26 2024-09-18T10:27:57.392 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-18T10:27:57.428 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-18T10:27:57.461 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-18T10:27:57.755 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-18T10:27:57.806 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:57.832 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:27:57.896 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 18/26 2024-09-18T10:27:57.910 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:27:57.910 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:27:57.910 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T10:27:57.911 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:27:57.911 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:27:57.911 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:27:57.912 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:27:57.979 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 19/26 2024-09-18T10:27:57.992 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:27:57.993 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:27:58.017 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 20/26 2024-09-18T10:27:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:27:58.704 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-18T10:27:58.704 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-18T10:27:58.704 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-18T10:27:58.705 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-18T10:27:58.705 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-18T10:27:58.705 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-18T10:27:58.705 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-18T10:27:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 6/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 7/26 2024-09-18T10:27:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 8/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 9/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 10/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 13/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-18T10:27:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-18T10:27:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-18T10:27:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:27:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-18T10:27:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 25/26 2024-09-18T10:28:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:28:00.154 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:28:00.154 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:00.154 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T10:28:00.154 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:28:00.154 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:28:00.154 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:00.155 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:28:00.252 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:28:00.252 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:00.316 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.317 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.318 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T10:28:00.319 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.319 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.319 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:00.319 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T10:28:00.319 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:00.319 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:00.492 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:28:00.530 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:28:00.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-test 2024-09-18T10:28:01.048 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 21/26 2024-09-18T10:28:01.092 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:28:01.185 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 22/26 2024-09-18T10:28:01.186 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T10:28:01.186 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T10:28:01.186 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:01.218 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:28:01.261 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 48 M 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 163 k 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T10:28:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-18T10:28:01.393 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 48 M 2024-09-18T10:28:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 193 M 2024-09-18T10:28:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:01.529 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:01.529 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/26 2024-09-18T10:28:01.529 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:28:01.529 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:28:01.529 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:28:01.529 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 6/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 7/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 8/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 9/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 10/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 13/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-18T10:28:01.530 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-18T10:28:01.531 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 25/26 2024-09-18T10:28:01.755 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-18T10:28:01.805 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-18T10:28:01.947 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): libcephsqlite-17.2.7-1645.g7061ea6c.el9. 389 kB/s | 163 kB 00:00 2024-09-18T10:28:02.349 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:02.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:02.349 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-18T10:28:02.349 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.349 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T10:28:02.350 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T10:28:02.351 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:02.352 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:02.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-test 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-18T10:28:03.266 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:03.333 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:03.431 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): ceph-test-17.2.7-1645.g7061ea6c.el9.x86_ 25 MB/s | 48 MB 00:01 2024-09-18T10:28:03.433 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:03.433 INFO:teuthology.orchestra.run.smithi071.stdout:Total 24 MB/s | 48 MB 00:02 2024-09-18T10:28:03.460 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:03.470 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 48 M 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:28:03.471 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 163 k 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-18T10:28:03.472 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:03.473 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 48 M 2024-09-18T10:28:03.473 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 193 M 2024-09-18T10:28:03.473 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:03.480 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:03.481 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:03.814 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): libcephsqlite-17.2.7-1645.g7061ea6c.el9. 775 kB/s | 163 kB 00:00 2024-09-18T10:28:03.844 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:03.845 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:04.189 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-09-18T10:28:04.248 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 472 kB/s | 304 kB 00:00 2024-09-18T10:28:04.364 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:04.440 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T10:28:04.487 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T10:28:04.515 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:04.567 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:28:04.637 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:28:04.638 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:04.638 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T10:28:04.638 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:28:04.638 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:28:04.638 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:04.640 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:28:04.729 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:28:04.729 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:05.082 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): ceph-test-17.2.7-1645.g7061ea6c.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-18T10:28:05.083 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:05.084 INFO:teuthology.orchestra.run.smithi063.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-18T10:28:05.112 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:05.134 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:05.134 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:05.520 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:05.521 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 6/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 7/26 2024-09-18T10:28:06.133 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 8/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 9/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 10/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 13/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-18T10:28:06.134 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-18T10:28:06.135 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:28:06.135 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-18T10:28:06.135 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 25/26 2024-09-18T10:28:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T10:28:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T10:28:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:07.154 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:07.154 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:07.154 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-18T10:28:07.154 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.155 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:07.156 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:07.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-test 2024-09-18T10:28:08.118 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:08.249 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 48 M 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 163 k 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:08.250 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:08.251 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:08.251 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-18T10:28:08.251 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:08.251 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 48 M 2024-09-18T10:28:08.251 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 193 M 2024-09-18T10:28:08.251 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:08.486 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-18T10:28:08.511 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): libcephsqlite-17.2.7-1645.g7061ea6c.el9. 682 kB/s | 163 kB 00:00 2024-09-18T10:28:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 956 kB/s | 64 kB 00:00 2024-09-18T10:28:09.217 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:09.295 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:09.829 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): ceph-test-17.2.7-1645.g7061ea6c.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-18T10:28:09.830 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:09.831 INFO:teuthology.orchestra.run.smithi100.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-18T10:28:09.858 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:09.876 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:09.877 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:10.241 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:10.241 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:10.763 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-09-18T10:28:10.814 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-09-18T10:28:10.815 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:10.833 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T10:28:10.877 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T10:28:10.906 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:11.008 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:11.531 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:11.531 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/4 2024-09-18T10:28:11.531 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/4 2024-09-18T10:28:11.531 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:11.866 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:12.151 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:28:12.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph 2024-09-18T10:28:12.229 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 24/26 2024-09-18T10:28:12.229 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:12.229 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T10:28:12.229 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:28:12.229 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T10:28:12.229 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:12.231 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:28:12.320 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T10:28:12.321 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:12.758 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:12.898 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:12.900 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:12.900 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:12.900 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 6.5 k 2024-09-18T10:28:12.900 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.1 M 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 1.4 M 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 240 k 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.9 M 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 15 M 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T10:28:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T10:28:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T10:28:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T10:28:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:12.904 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:12.904 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:12.904 INFO:teuthology.orchestra.run.smithi071.stdout:Install 34 Packages 2024-09-18T10:28:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:12.904 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 27 M 2024-09-18T10:28:12.905 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 96 M 2024-09-18T10:28:12.905 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:13.233 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:13.233 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/4 2024-09-18T10:28:13.233 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/4 2024-09-18T10:28:13.234 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T10:28:13.574 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T10:28:13.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:13.574 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:13.574 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:13.574 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:13.574 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T10:28:13.575 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T10:28:13.575 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:13.575 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:13.598 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:13.598 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/26 2024-09-18T10:28:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/26 2024-09-18T10:28:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/26 2024-09-18T10:28:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/26 2024-09-18T10:28:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/26 2024-09-18T10:28:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_6 6/26 2024-09-18T10:28:13.599 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 7/26 2024-09-18T10:28:13.600 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9. 8/26 2024-09-18T10:28:13.600 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x8 9/26 2024-09-18T10:28:13.600 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 10/26 2024-09-18T10:28:13.600 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 11/26 2024-09-18T10:28:13.600 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 12/26 2024-09-18T10:28:13.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 13/26 2024-09-18T10:28:13.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-18T10:28:13.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-18T10:28:13.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-18T10:28:13.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-18T10:28:13.601 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-18T10:28:13.602 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-18T10:28:13.602 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-18T10:28:13.602 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-18T10:28:13.602 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-18T10:28:13.602 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 23/26 2024-09-18T10:28:13.603 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-18T10:28:13.603 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 25/26 2024-09-18T10:28:13.729 INFO:teuthology.orchestra.run.smithi071.stdout:(1/34): ceph-17.2.7-1645.g7061ea6c.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-18T10:28:13.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph 2024-09-18T10:28:13.938 INFO:teuthology.orchestra.run.smithi071.stdout:(2/34): ceph-mds-17.2.7-1645.g7061ea6c.el9.x86_ 6.2 MB/s | 2.1 MB 00:00 2024-09-18T10:28:13.979 INFO:teuthology.orchestra.run.smithi071.stdout:(3/34): ceph-mgr-17.2.7-1645.g7061ea6c.el9.x86_ 3.7 MB/s | 1.4 MB 00:00 2024-09-18T10:28:14.071 INFO:teuthology.orchestra.run.smithi071.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1645.g7061 2.6 MB/s | 240 kB 00:00 2024-09-18T10:28:14.297 INFO:teuthology.orchestra.run.smithi071.stdout:(5/34): ceph-mon-17.2.7-1645.g7061ea6c.el9.x86_ 6.9 MB/s | 3.9 MB 00:00 2024-09-18T10:28:14.322 INFO:teuthology.orchestra.run.smithi071.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-18T10:28:14.454 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:39 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:14.489 INFO:teuthology.orchestra.run.smithi071.stdout:(7/34): ceph-osd-17.2.7-1645.g7061ea6c.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-18T10:28:14.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T10:28:14.502 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:14.502 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-09-18T10:28:14.502 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.502 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.502 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T10:28:14.503 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T10:28:14.504 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:14.505 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:14.514 INFO:teuthology.orchestra.run.smithi071.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 555 kB/s | 106 kB 00:00 2024-09-18T10:28:14.573 INFO:teuthology.orchestra.run.smithi071.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-18T10:28:14.604 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:14.606 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:14.606 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:14.606 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 6.5 k 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.1 M 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 1.4 M 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 240 k 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.9 M 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 15 M 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T10:28:14.607 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T10:28:14.608 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T10:28:14.609 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout:Install 34 Packages 2024-09-18T10:28:14.610 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:14.611 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 27 M 2024-09-18T10:28:14.611 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 96 M 2024-09-18T10:28:14.611 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:14.640 INFO:teuthology.orchestra.run.smithi071.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-18T10:28:14.665 INFO:teuthology.orchestra.run.smithi071.stdout:(11/34): python3-pycparser-2.20-6.el9.noarch.rp 770 kB/s | 135 kB 00:00 2024-09-18T10:28:14.698 INFO:teuthology.orchestra.run.smithi071.stdout:(12/34): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2024-09-18T10:28:14.774 INFO:teuthology.orchestra.run.smithi071.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-18T10:28:14.824 INFO:teuthology.orchestra.run.smithi071.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 616 kB/s | 77 kB 00:00 2024-09-18T10:28:14.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-test 2024-09-18T10:28:14.849 INFO:teuthology.orchestra.run.smithi071.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-18T10:28:14.874 INFO:teuthology.orchestra.run.smithi071.stdout:(16/34): python3-mako-1.1.4-6.el9.noarch.rpm 734 kB/s | 172 kB 00:00 2024-09-18T10:28:14.891 INFO:teuthology.orchestra.run.smithi071.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-09-18T10:28:14.933 INFO:teuthology.orchestra.run.smithi071.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 517 kB/s | 43 kB 00:00 2024-09-18T10:28:14.956 INFO:teuthology.orchestra.run.smithi063.stdout:(1/34): ceph-17.2.7-1645.g7061ea6c.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-18T10:28:14.959 INFO:teuthology.orchestra.run.smithi071.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 463 kB/s | 11 kB 00:00 2024-09-18T10:28:14.984 INFO:teuthology.orchestra.run.smithi071.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-18T10:28:15.009 INFO:teuthology.orchestra.run.smithi071.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-18T10:28:15.034 INFO:teuthology.orchestra.run.smithi071.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 934 kB/s | 23 kB 00:00 2024-09-18T10:28:15.060 INFO:teuthology.orchestra.run.smithi071.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-18T10:28:15.085 INFO:teuthology.orchestra.run.smithi071.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 797 kB/s | 20 kB 00:00 2024-09-18T10:28:15.110 INFO:teuthology.orchestra.run.smithi071.stdout:(25/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-09-18T10:28:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:(2/34): ceph-mgr-17.2.7-1645.g7061ea6c.el9.x86_ 4.8 MB/s | 1.4 MB 00:00 2024-09-18T10:28:15.135 INFO:teuthology.orchestra.run.smithi071.stdout:(26/34): python3-logutils-0.3.5-21.el9.noarch.r 618 kB/s | 46 kB 00:00 2024-09-18T10:28:15.156 INFO:teuthology.orchestra.run.smithi063.stdout:(3/34): ceph-mds-17.2.7-1645.g7061ea6c.el9.x86_ 6.2 MB/s | 2.1 MB 00:00 2024-09-18T10:28:15.160 INFO:teuthology.orchestra.run.smithi071.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T10:28:15.186 INFO:teuthology.orchestra.run.smithi071.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-18T10:28:15.211 INFO:teuthology.orchestra.run.smithi071.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-18T10:28:15.236 INFO:teuthology.orchestra.run.smithi071.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-18T10:28:15.257 INFO:teuthology.orchestra.run.smithi063.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1645.g7061 2.3 MB/s | 240 kB 00:00 2024-09-18T10:28:15.262 INFO:teuthology.orchestra.run.smithi071.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-18T10:28:15.290 INFO:teuthology.orchestra.run.smithi071.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2024-09-18T10:28:15.315 INFO:teuthology.orchestra.run.smithi071.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 376 kB/s | 20 kB 00:00 2024-09-18T10:28:15.340 INFO:teuthology.orchestra.run.smithi071.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.0 MB/s | 427 kB 00:00 2024-09-18T10:28:15.341 INFO:teuthology.orchestra.run.smithi063.stdout:(5/34): ceph-mon-17.2.7-1645.g7061ea6c.el9.x86_ 10 MB/s | 3.9 MB 00:00 2024-09-18T10:28:15.345 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:15.345 INFO:teuthology.orchestra.run.smithi071.stdout:Total 11 MB/s | 27 MB 00:02 2024-09-18T10:28:15.417 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:15.424 INFO:teuthology.orchestra.run.smithi063.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-18T10:28:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:15.466 INFO:teuthology.orchestra.run.smithi063.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-18T10:28:15.478 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:15.514 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:15.515 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:15.549 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 48 M 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 163 k 2024-09-18T10:28:15.550 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T10:28:15.551 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T10:28:15.551 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:15.551 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:28:15.551 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:15.551 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-09-18T10:28:15.551 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:15.552 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 48 M 2024-09-18T10:28:15.552 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 193 M 2024-09-18T10:28:15.552 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:28:15.625 INFO:teuthology.orchestra.run.smithi063.stdout:(8/34): ceph-osd-17.2.7-1645.g7061ea6c.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-18T10:28:15.650 INFO:teuthology.orchestra.run.smithi063.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 737 kB/s | 135 kB 00:00 2024-09-18T10:28:15.700 INFO:teuthology.orchestra.run.smithi063.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 3.4 MB/s | 1.2 MB 00:00 2024-09-18T10:28:15.726 INFO:teuthology.orchestra.run.smithi063.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-18T10:28:15.776 INFO:teuthology.orchestra.run.smithi063.stdout:(12/34): python3-requests-2.25.1-8.el9.noarch.r 830 kB/s | 125 kB 00:00 2024-09-18T10:28:15.851 INFO:teuthology.orchestra.run.smithi063.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 277 kB/s | 35 kB 00:00 2024-09-18T10:28:15.893 INFO:teuthology.orchestra.run.smithi063.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 895 kB/s | 172 kB 00:00 2024-09-18T10:28:15.903 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:15.903 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:15.926 INFO:teuthology.orchestra.run.smithi063.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-18T10:28:15.952 INFO:teuthology.orchestra.run.smithi063.stdout:(16/34): python3-packaging-20.9-5.el9.noarch.rp 439 kB/s | 77 kB 00:00 2024-09-18T10:28:15.969 INFO:teuthology.orchestra.run.smithi063.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-18T10:28:16.010 INFO:teuthology.orchestra.run.smithi063.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 519 kB/s | 43 kB 00:00 2024-09-18T10:28:16.027 INFO:teuthology.orchestra.run.smithi063.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 729 kB/s | 11 kB 00:00 2024-09-18T10:28:16.050 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): libcephsqlite-17.2.7-1645.g7061ea6c.el9. 743 kB/s | 163 kB 00:00 2024-09-18T10:28:16.053 INFO:teuthology.orchestra.run.smithi063.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-18T10:28:16.078 INFO:teuthology.orchestra.run.smithi063.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-18T10:28:16.103 INFO:teuthology.orchestra.run.smithi063.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-18T10:28:16.129 INFO:teuthology.orchestra.run.smithi063.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-18T10:28:16.154 INFO:teuthology.orchestra.run.smithi063.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-18T10:28:16.179 INFO:teuthology.orchestra.run.smithi063.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 927 kB/s | 46 kB 00:00 2024-09-18T10:28:16.204 INFO:teuthology.orchestra.run.smithi063.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T10:28:16.246 INFO:teuthology.orchestra.run.smithi063.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-18T10:28:16.271 INFO:teuthology.orchestra.run.smithi063.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 246 kB/s | 16 kB 00:00 2024-09-18T10:28:16.296 INFO:teuthology.orchestra.run.smithi063.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-18T10:28:16.322 INFO:teuthology.orchestra.run.smithi063.stdout:(30/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-18T10:28:16.372 INFO:teuthology.orchestra.run.smithi063.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-18T10:28:16.414 INFO:teuthology.orchestra.run.smithi063.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-18T10:28:16.439 INFO:teuthology.orchestra.run.smithi063.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2024-09-18T10:28:16.464 INFO:teuthology.orchestra.run.smithi063.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-09-18T10:28:16.469 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:16.469 INFO:teuthology.orchestra.run.smithi063.stdout:Total 15 MB/s | 27 MB 00:01 2024-09-18T10:28:16.600 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:16.642 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:16.642 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:16.734 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-18T10:28:16.759 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 328 kB/s | 304 kB 00:00 2024-09-18T10:28:17.066 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:17.067 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:17.154 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:17.210 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-18T10:28:17.242 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-18T10:28:17.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-18T10:28:17.301 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): ceph-test-17.2.7-1645.g7061ea6c.el9.x86_ 33 MB/s | 48 MB 00:01 2024-09-18T10:28:17.304 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:17.304 INFO:teuthology.orchestra.run.smithi160.stdout:Total 28 MB/s | 48 MB 00:01 2024-09-18T10:28:17.331 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:28:17.351 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:28:17.351 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:28:17.367 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-18T10:28:17.436 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-18T10:28:17.485 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-18T10:28:17.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-18T10:28:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-18T10:28:17.585 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-18T10:28:17.627 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-18T10:28:17.667 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-18T10:28:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-18T10:28:17.717 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:28:17.717 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:28:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-18T10:28:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-18T10:28:17.785 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:17.785 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/4 2024-09-18T10:28:17.785 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/4 2024-09-18T10:28:17.785 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T10:28:17.828 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:17.906 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-18T10:28:18.053 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T10:28:18.097 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:18.098 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:18.132 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-18T10:28:18.186 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-18T10:28:18.225 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-18T10:28:18.235 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:28:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-18T10:28:18.310 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T10:28:18.334 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-18T10:28:18.358 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T10:28:18.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph 2024-09-18T10:28:18.386 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:18.392 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-18T10:28:18.426 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-18T10:28:18.458 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-18T10:28:18.530 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-18T10:28:18.555 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-18T10:28:18.578 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-18T10:28:18.640 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-18T10:28:18.663 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-18T10:28:18.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-18T10:28:18.738 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-18T10:28:18.752 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-18T10:28:18.776 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-18T10:28:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-18T10:28:18.810 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-18T10:28:18.843 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-18T10:28:18.884 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-18T10:28:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-18T10:28:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-18T10:28:18.953 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:37 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-18T10:28:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-18T10:28:19.070 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:19.072 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 29/34 2024-09-18T10:28:19.086 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:19.089 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:19.089 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:28:19.089 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:19.089 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:19.089 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 6.5 k 2024-09-18T10:28:19.090 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:28:19.090 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.1 M 2024-09-18T10:28:19.090 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 1.4 M 2024-09-18T10:28:19.090 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 240 k 2024-09-18T10:28:19.090 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.9 M 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 15 M 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T10:28:19.091 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T10:28:19.092 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout:Install 34 Packages 2024-09-18T10:28:19.093 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:19.094 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 27 M 2024-09-18T10:28:19.094 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 96 M 2024-09-18T10:28:19.094 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:19.104 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:19.129 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:19.129 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:19.129 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T10:28:19.129 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:19.130 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:19.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:19.147 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-18T10:28:19.310 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-18T10:28:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-18T10:28:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-18T10:28:19.495 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-18T10:28:19.554 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-18T10:28:19.617 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-18T10:28:19.814 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-18T10:28:19.855 INFO:teuthology.orchestra.run.smithi100.stdout:(1/34): ceph-17.2.7-1645.g7061ea6c.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-18T10:28:19.866 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-18T10:28:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-18T10:28:20.045 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-18T10:28:20.089 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-18T10:28:20.210 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-18T10:28:20.367 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 29/34 2024-09-18T10:28:20.399 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:20.426 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:20.426 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:20.426 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T10:28:20.426 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:20.426 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:20.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:20.457 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:20.457 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:20.457 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T10:28:20.457 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:20.457 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:20.457 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:20.505 INFO:teuthology.orchestra.run.smithi100.stdout:(2/34): ceph-mgr-17.2.7-1645.g7061ea6c.el9.x86_ 1.8 MB/s | 1.4 MB 00:00 2024-09-18T10:28:20.613 INFO:teuthology.orchestra.run.smithi100.stdout:(3/34): ceph-mds-17.2.7-1645.g7061ea6c.el9.x86_ 2.3 MB/s | 2.1 MB 00:00 2024-09-18T10:28:20.755 INFO:teuthology.orchestra.run.smithi100.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1645.g7061 1.7 MB/s | 240 kB 00:00 2024-09-18T10:28:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:20.863 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:20.863 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T10:28:20.863 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:20.863 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:20.964 INFO:teuthology.orchestra.run.smithi100.stdout:(5/34): ceph-mon-17.2.7-1645.g7061ea6c.el9.x86_ 3.5 MB/s | 3.9 MB 00:01 2024-09-18T10:28:20.989 INFO:teuthology.orchestra.run.smithi100.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-18T10:28:21.031 INFO:teuthology.orchestra.run.smithi100.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-18T10:28:21.064 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:21.088 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:21.089 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:21.089 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T10:28:21.089 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:21.089 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:21.089 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:21.089 INFO:teuthology.orchestra.run.smithi100.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-18T10:28:21.139 INFO:teuthology.orchestra.run.smithi100.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-18T10:28:21.152 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:21.198 INFO:teuthology.orchestra.run.smithi100.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-18T10:28:21.265 INFO:teuthology.orchestra.run.smithi100.stdout:(11/34): python3-cryptography-36.0.1-4.el9.x86_ 4.1 MB/s | 1.2 MB 00:00 2024-09-18T10:28:21.549 INFO:teuthology.orchestra.run.smithi100.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 123 kB/s | 35 kB 00:00 2024-09-18T10:28:21.699 INFO:teuthology.orchestra.run.smithi100.stdout:(13/34): ceph-osd-17.2.7-1645.g7061ea6c.el9.x86 13 MB/s | 15 MB 00:01 2024-09-18T10:28:21.741 INFO:teuthology.orchestra.run.smithi100.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 317 kB/s | 172 kB 00:00 2024-09-18T10:28:21.833 INFO:teuthology.orchestra.run.smithi100.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 272 kB/s | 77 kB 00:00 2024-09-18T10:28:21.834 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:21.858 INFO:teuthology.orchestra.run.smithi100.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-18T10:28:21.866 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:21.866 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:21.866 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T10:28:21.866 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:21.866 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:21.867 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:21.900 INFO:teuthology.orchestra.run.smithi100.stdout:(17/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 651 kB/s | 43 kB 00:00 2024-09-18T10:28:21.934 INFO:teuthology.orchestra.run.smithi100.stdout:(18/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-18T10:28:21.959 INFO:teuthology.orchestra.run.smithi100.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-18T10:28:21.984 INFO:teuthology.orchestra.run.smithi100.stdout:(20/34): python3-cherrypy-18.6.1-2.el9.noarch.r 4.3 MB/s | 358 kB 00:00 2024-09-18T10:28:22.001 INFO:teuthology.orchestra.run.smithi100.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 423 kB/s | 18 kB 00:00 2024-09-18T10:28:22.018 INFO:teuthology.orchestra.run.smithi100.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 693 kB/s | 23 kB 00:00 2024-09-18T10:28:22.035 INFO:teuthology.orchestra.run.smithi100.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 576 kB/s | 19 kB 00:00 2024-09-18T10:28:22.052 INFO:teuthology.orchestra.run.smithi100.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 583 kB/s | 20 kB 00:00 2024-09-18T10:28:22.069 INFO:teuthology.orchestra.run.smithi100.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-18T10:28:22.086 INFO:teuthology.orchestra.run.smithi100.stdout:(26/34): python3-pytz-2021.1-5.el9.noarch.rpm 132 kB/s | 51 kB 00:00 2024-09-18T10:28:22.131 INFO:teuthology.orchestra.run.smithi100.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 998 kB/s | 79 kB 00:00 2024-09-18T10:28:22.178 INFO:teuthology.orchestra.run.smithi100.stdout:(28/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.2 MB/s | 90 kB 00:00 2024-09-18T10:28:22.203 INFO:teuthology.orchestra.run.smithi100.stdout:(29/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-18T10:28:22.240 INFO:teuthology.orchestra.run.smithi100.stdout:(30/34): python3-portend-3.1.0-2.el9.noarch.rpm 106 kB/s | 16 kB 00:00 2024-09-18T10:28:22.260 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:22.266 INFO:teuthology.orchestra.run.smithi100.stdout:(31/34): python3-tempora-5.0.0-2.el9.noarch.rpm 409 kB/s | 36 kB 00:00 2024-09-18T10:28:22.285 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T10:28:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:22.285 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:22.285 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:22.291 INFO:teuthology.orchestra.run.smithi100.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.6 MB/s | 230 kB 00:00 2024-09-18T10:28:22.316 INFO:teuthology.orchestra.run.smithi100.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-18T10:28:22.358 INFO:teuthology.orchestra.run.smithi100.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-18T10:28:22.362 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:22.363 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.3 MB/s | 27 MB 00:03 2024-09-18T10:28:22.496 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:22.509 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:22.534 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:22.534 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:22.535 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:22.535 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:22.535 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T10:28:22.535 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:22.535 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:22.535 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:22.601 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/4 2024-09-18T10:28:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:22.838 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/34 2024-09-18T10:28:22.839 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/34 2024-09-18T10:28:22.839 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/34 2024-09-18T10:28:22.839 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/34 2024-09-18T10:28:22.839 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/34 2024-09-18T10:28:22.839 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 6/34 2024-09-18T10:28:22.840 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-18T10:28:22.840 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-18T10:28:22.840 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-18T10:28:22.840 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-18T10:28:22.840 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-18T10:28:22.840 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-18T10:28:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-18T10:28:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-18T10:28:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-18T10:28:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-18T10:28:22.841 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-18T10:28:22.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-18T10:28:22.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-18T10:28:22.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-18T10:28:22.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-18T10:28:22.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-18T10:28:22.842 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-18T10:28:22.843 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-18T10:28:22.843 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-18T10:28:22.843 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-18T10:28:22.843 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-18T10:28:22.843 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-18T10:28:22.843 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-18T10:28:22.844 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-18T10:28:22.844 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-18T10:28:22.844 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-18T10:28:22.884 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:22.928 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:22.928 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T10:28:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T10:28:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:23.883 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:24.159 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:24.211 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-18T10:28:24.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-base 2024-09-18T10:28:24.251 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-18T10:28:24.293 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-18T10:28:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/34 2024-09-18T10:28:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/34 2024-09-18T10:28:24.312 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 6/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:24.313 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-18T10:28:24.314 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-18T10:28:24.315 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-18T10:28:24.393 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-18T10:28:24.471 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-18T10:28:24.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-18T10:28:24.548 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-18T10:28:24.577 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-18T10:28:24.612 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-18T10:28:24.645 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-18T10:28:24.685 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-18T10:28:24.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-18T10:28:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-18T10:28:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-18T10:28:24.829 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:24.848 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:24.918 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:24.924 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-18T10:28:24.960 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:24.961 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:28:24.961 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:25.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install cephadm 2024-09-18T10:28:25.072 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-18T10:28:25.127 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/4 2024-09-18T10:28:25.127 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/4 2024-09-18T10:28:25.127 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/4 2024-09-18T10:28:25.127 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T10:28:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-18T10:28:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-18T10:28:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-18T10:28:25.292 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-18T10:28:25.297 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-18T10:28:25.297 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:25.297 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:25.297 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.297 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.297 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T10:28:25.298 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T10:28:25.299 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:25.300 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:25.347 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:25.450 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:25.531 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-18T10:28:25.591 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-18T10:28:25.604 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:25.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-base 2024-09-18T10:28:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-18T10:28:25.736 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:25.736 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:25.736 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 83 k 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 83 k 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 375 k 2024-09-18T10:28:25.737 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:25.749 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-18T10:28:25.750 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph 2024-09-18T10:28:25.800 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-18T10:28:25.912 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-18T10:28:25.928 INFO:teuthology.orchestra.run.smithi071.stdout:cephadm-17.2.7-1645.g7061ea6c.el9.noarch.rpm 433 kB/s | 83 kB 00:00 2024-09-18T10:28:25.929 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:25.929 INFO:teuthology.orchestra.run.smithi071.stdout:Total 430 kB/s | 83 kB 00:00 2024-09-18T10:28:25.929 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:25.934 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:25.934 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:25.936 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:25.937 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:26.013 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:26.070 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 29/34 2024-09-18T10:28:26.093 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:26.118 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:26.118 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:26.118 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T10:28:26.118 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:26.118 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:26.118 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:26.240 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:26.326 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:26.330 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:26.375 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:26.376 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:28:26.376 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:26.393 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:26.437 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install cephadm 2024-09-18T10:28:26.465 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:26.467 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:26.467 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:28:26.467 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 6.5 k 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.1 M 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 1.4 M 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 240 k 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 3.9 M 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 15 M 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T10:28:26.468 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T10:28:26.469 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T10:28:26.470 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T10:28:26.471 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:26.471 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:28:26.471 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:26.471 INFO:teuthology.orchestra.run.smithi160.stdout:Install 34 Packages 2024-09-18T10:28:26.471 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:26.471 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 27 M 2024-09-18T10:28:26.472 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 96 M 2024-09-18T10:28:26.472 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:28:26.492 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:26.850 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:27.037 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:52 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:27.128 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:27.128 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:27.128 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:27.128 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:27.128 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:27.128 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:27.174 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 83 k 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 83 k 2024-09-18T10:28:27.175 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 375 k 2024-09-18T10:28:27.176 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:27.259 INFO:teuthology.orchestra.run.smithi160.stdout:(1/34): ceph-17.2.7-1645.g7061ea6c.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-18T10:28:27.359 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T10:28:27.360 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm-17.2.7-1645.g7061ea6c.el9.noarch.rpm 452 kB/s | 83 kB 00:00 2024-09-18T10:28:27.360 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:27.361 INFO:teuthology.orchestra.run.smithi063.stdout:Total 448 kB/s | 83 kB 00:00 2024-09-18T10:28:27.361 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:27.365 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:27.366 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:27.367 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:27.368 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:27.443 INFO:teuthology.orchestra.run.smithi160.stdout:(2/34): ceph-mgr-17.2.7-1645.g7061ea6c.el9.x86_ 4.6 MB/s | 1.4 MB 00:00 2024-09-18T10:28:27.448 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:27.460 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:27.485 INFO:teuthology.orchestra.run.smithi160.stdout:(3/34): ceph-mds-17.2.7-1645.g7061ea6c.el9.x86_ 5.9 MB/s | 2.1 MB 00:00 2024-09-18T10:28:27.490 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:27.490 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:27.490 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T10:28:27.490 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:27.490 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:27.490 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:27.585 INFO:teuthology.orchestra.run.smithi160.stdout:(4/34): ceph-mon-17.2.7-1645.g7061ea6c.el9.x86_ 12 MB/s | 3.9 MB 00:00 2024-09-18T10:28:27.611 INFO:teuthology.orchestra.run.smithi160.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1645.g7061 1.9 MB/s | 240 kB 00:00 2024-09-18T10:28:27.786 INFO:teuthology.orchestra.run.smithi160.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-18T10:28:27.826 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:27.878 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:27.902 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:27.902 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:27.902 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T10:28:27.902 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:27.903 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:27.903 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:27.931 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:27.953 INFO:teuthology.orchestra.run.smithi160.stdout:(7/34): ceph-osd-17.2.7-1645.g7061ea6c.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-18T10:28:27.953 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:27.978 INFO:teuthology.orchestra.run.smithi160.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 555 kB/s | 106 kB 00:00 2024-09-18T10:28:28.029 INFO:teuthology.orchestra.run.smithi160.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-18T10:28:28.062 INFO:teuthology.orchestra.run.smithi160.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-18T10:28:28.088 INFO:teuthology.orchestra.run.smithi160.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 137 k 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:28:28.089 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:28.090 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 137 k 2024-09-18T10:28:28.090 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 379 k 2024-09-18T10:28:28.090 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:28.103 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:28.121 INFO:teuthology.orchestra.run.smithi160.stdout:(12/34): python3-pycparser-2.20-6.el9.noarch.rp 807 kB/s | 135 kB 00:00 2024-09-18T10:28:28.127 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:28.128 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:28.128 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T10:28:28.128 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:28.128 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:28.128 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:28.200 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:28.204 INFO:teuthology.orchestra.run.smithi160.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-18T10:28:28.246 INFO:teuthology.orchestra.run.smithi160.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 617 kB/s | 77 kB 00:00 2024-09-18T10:28:28.268 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:28.283 INFO:teuthology.orchestra.run.smithi160.stdout:(15/34): python3-mako-1.1.4-6.el9.noarch.rpm 780 kB/s | 172 kB 00:00 2024-09-18T10:28:28.301 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-immutable-object-cache-17.2.7-1645.g7061ea 651 kB/s | 137 kB 00:00 2024-09-18T10:28:28.302 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:28.302 INFO:teuthology.orchestra.run.smithi071.stdout:Total 646 kB/s | 137 kB 00:00 2024-09-18T10:28:28.302 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:28.309 INFO:teuthology.orchestra.run.smithi160.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 492 kB/s | 51 kB 00:00 2024-09-18T10:28:28.309 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:28.309 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:28.334 INFO:teuthology.orchestra.run.smithi160.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 478 kB/s | 42 kB 00:00 2024-09-18T10:28:28.367 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:28.367 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:28.384 INFO:teuthology.orchestra.run.smithi160.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-18T10:28:28.417 INFO:teuthology.orchestra.run.smithi160.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 341 kB/s | 11 kB 00:00 2024-09-18T10:28:28.443 INFO:teuthology.orchestra.run.smithi160.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-18T10:28:28.468 INFO:teuthology.orchestra.run.smithi160.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-18T10:28:28.500 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:28.500 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:28.500 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:28.500 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:28.500 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:28.501 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:28.502 INFO:teuthology.orchestra.run.smithi160.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 393 kB/s | 23 kB 00:00 2024-09-18T10:28:28.511 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:28.527 INFO:teuthology.orchestra.run.smithi160.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 329 kB/s | 19 kB 00:00 2024-09-18T10:28:28.553 INFO:teuthology.orchestra.run.smithi160.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-18T10:28:28.568 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:28.578 INFO:teuthology.orchestra.run.smithi160.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-18T10:28:28.593 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:28.593 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:28.593 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T10:28:28.594 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:28.603 INFO:teuthology.orchestra.run.smithi160.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-18T10:28:28.629 INFO:teuthology.orchestra.run.smithi160.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-18T10:28:28.654 INFO:teuthology.orchestra.run.smithi160.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-18T10:28:28.679 INFO:teuthology.orchestra.run.smithi160.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-18T10:28:28.696 INFO:teuthology.orchestra.run.smithi160.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 854 kB/s | 36 kB 00:00 2024-09-18T10:28:28.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T10:28:28.729 INFO:teuthology.orchestra.run.smithi160.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-18T10:28:28.755 INFO:teuthology.orchestra.run.smithi160.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-18T10:28:28.772 INFO:teuthology.orchestra.run.smithi160.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 478 kB/s | 20 kB 00:00 2024-09-18T10:28:28.797 INFO:teuthology.orchestra.run.smithi160.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-18T10:28:28.802 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:28.802 INFO:teuthology.orchestra.run.smithi160.stdout:Total 12 MB/s | 27 MB 00:02 2024-09-18T10:28:28.931 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:28:28.970 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:28:28.970 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:28:29.298 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:29.361 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:28:29.361 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:28:29.435 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:29.435 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:29.435 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-09-18T10:28:29.435 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 137 k 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:28:29.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:29.437 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 137 k 2024-09-18T10:28:29.437 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 379 k 2024-09-18T10:28:29.437 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:29.519 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:29.519 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:29.519 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:29.519 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:29.519 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:29.519 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:29.656 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-immutable-object-cache-17.2.7-1645.g7061ea 628 kB/s | 137 kB 00:00 2024-09-18T10:28:29.656 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:29.657 INFO:teuthology.orchestra.run.smithi063.stdout:Total 623 kB/s | 137 kB 00:00 2024-09-18T10:28:29.657 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:29.665 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:29.665 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:29.725 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:29.727 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:29.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr 2024-09-18T10:28:29.867 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:29.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/34 2024-09-18T10:28:29.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/34 2024-09-18T10:28:29.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/34 2024-09-18T10:28:29.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/34 2024-09-18T10:28:29.867 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 6/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-18T10:28:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-18T10:28:29.869 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-18T10:28:29.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-18T10:28:29.870 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-18T10:28:29.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-18T10:28:29.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-18T10:28:29.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-18T10:28:29.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-18T10:28:29.873 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:29.940 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:29.966 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:29.967 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:29.967 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T10:28:29.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:30.347 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:30.439 INFO:teuthology.orchestra.run.smithi071.stdout:Package ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:30.483 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:30.484 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:28:30.484 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:30.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T10:28:30.585 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:28:30.658 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-18T10:28:30.690 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-18T10:28:30.723 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-18T10:28:30.815 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-18T10:28:30.894 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-18T10:28:30.903 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-18T10:28:30.903 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:30.903 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T10:28:30.904 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T10:28:30.905 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:30.906 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:30.934 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-18T10:28:30.948 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:30.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:30.949 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:30.949 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:30.949 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:30.949 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:30.969 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-18T10:28:30.999 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-18T10:28:31.034 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-18T10:28:31.067 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-18T10:28:31.107 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-18T10:28:31.127 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:31.142 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-18T10:28:31.176 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr 2024-09-18T10:28:31.176 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-18T10:28:31.225 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-18T10:28:31.259 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 3.4 M 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 24 k 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 15 k 2024-09-18T10:28:31.260 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout:Install 7 Packages 2024-09-18T10:28:31.261 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:31.262 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 3.7 M 2024-09-18T10:28:31.262 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 80 M 2024-09-18T10:28:31.262 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:31.269 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:31.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-base 2024-09-18T10:28:31.363 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-18T10:28:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-18T10:28:31.580 INFO:teuthology.orchestra.run.smithi071.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1645.g706 159 kB/s | 24 kB 00:00 2024-09-18T10:28:31.581 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-18T10:28:31.597 INFO:teuthology.orchestra.run.smithi071.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1645.g7061 86 kB/s | 15 kB 00:00 2024-09-18T10:28:31.639 INFO:teuthology.orchestra.run.smithi071.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 155 kB/s | 9.0 kB 00:00 2024-09-18T10:28:31.642 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-18T10:28:31.672 INFO:teuthology.orchestra.run.smithi071.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 973 kB/s | 31 kB 00:00 2024-09-18T10:28:31.681 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-18T10:28:31.698 INFO:teuthology.orchestra.run.smithi071.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 408 kB/s | 41 kB 00:00 2024-09-18T10:28:31.723 INFO:teuthology.orchestra.run.smithi071.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-18T10:28:31.739 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-18T10:28:31.778 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:31.802 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-18T10:28:31.806 INFO:teuthology.orchestra.run.smithi071.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1645.g7061ea6c 8.8 MB/s | 3.4 MB 00:00 2024-09-18T10:28:31.809 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Total 6.7 MB/s | 3.7 MB 00:00 2024-09-18T10:28:31.810 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:31.818 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:31.818 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:31.871 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:31.899 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:31.900 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:31.907 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:31.915 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:31.916 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:28:31.916 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:31.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T10:28:31.989 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-18T10:28:31.994 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:32.036 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:32.036 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-18T10:28:32.036 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:28:32.037 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:32.114 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-18T10:28:32.120 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install cephadm 2024-09-18T10:28:32.210 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-18T10:28:32.211 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:32.255 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-18T10:28:32.266 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T10:28:32.308 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T10:28:32.355 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T10:28:32.375 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-18T10:28:32.386 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T10:28:32.415 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 5/7 2024-09-18T10:28:32.530 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 29/34 2024-09-18T10:28:32.561 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:32.578 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:32.585 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 30/34 2024-09-18T10:28:32.585 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:32.586 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T10:28:32.586 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:32.586 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T10:28:32.586 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:32.690 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:32.715 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 3.4 M 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 24 k 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 15 k 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T10:28:32.716 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout:Install 7 Packages 2024-09-18T10:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:32.718 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 3.7 M 2024-09-18T10:28:32.718 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 80 M 2024-09-18T10:28:32.718 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:32.822 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:32.822 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:32.822 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:28:32.822 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 83 k 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 83 k 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 375 k 2024-09-18T10:28:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:33.010 INFO:teuthology.orchestra.run.smithi100.stdout:cephadm-17.2.7-1645.g7061ea6c.el9.noarch.rpm 443 kB/s | 83 kB 00:00 2024-09-18T10:28:33.011 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:33.011 INFO:teuthology.orchestra.run.smithi100.stdout:Total 439 kB/s | 83 kB 00:00 2024-09-18T10:28:33.011 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:33.016 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:33.016 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:33.018 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:33.018 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:33.107 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:33.250 INFO:teuthology.orchestra.run.smithi063.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1645.g706 152 kB/s | 24 kB 00:00 2024-09-18T10:28:33.275 INFO:teuthology.orchestra.run.smithi063.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1645.g7061 79 kB/s | 15 kB 00:00 2024-09-18T10:28:33.317 INFO:teuthology.orchestra.run.smithi063.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-18T10:28:33.343 INFO:teuthology.orchestra.run.smithi063.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-18T10:28:33.368 INFO:teuthology.orchestra.run.smithi063.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-18T10:28:33.393 INFO:teuthology.orchestra.run.smithi063.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-18T10:28:33.409 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 6/7 2024-09-18T10:28:33.444 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:33.493 INFO:teuthology.orchestra.run.smithi063.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1645.g7061ea6c 8.3 MB/s | 3.4 MB 00:00 2024-09-18T10:28:33.497 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:33.498 INFO:teuthology.orchestra.run.smithi063.stdout:Total 4.7 MB/s | 3.7 MB 00:00 2024-09-18T10:28:33.498 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:33.507 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:33.508 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:33.567 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:33.603 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:33.604 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:33.672 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:33.896 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:33.911 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:33.921 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 31/34 2024-09-18T10:28:33.922 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:33.922 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T10:28:33.922 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:33.922 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T10:28:33.922 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:33.970 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T10:28:34.005 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T10:28:34.046 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:34.052 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T10:28:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T10:28:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 5/7 2024-09-18T10:28:34.299 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:34.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:34.299 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:34.299 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:34.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:34.299 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:34.305 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:34.331 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 32/34 2024-09-18T10:28:34.331 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:34.331 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T10:28:34.331 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:34.331 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T10:28:34.331 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:34.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T10:28:34.531 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:34.536 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:34.536 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 1/7 2024-09-18T10:28:34.536 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 2/7 2024-09-18T10:28:34.536 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 3/7 2024-09-18T10:28:34.537 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T10:28:34.537 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T10:28:34.537 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T10:28:34.556 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 33/34 2024-09-18T10:28:34.556 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:34.556 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T10:28:34.557 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:34.557 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T10:28:34.557 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:34.620 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T10:28:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:34.818 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:34.818 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:34.819 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:35.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T10:28:35.074 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:54 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:35.165 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 6/7 2024-09-18T10:28:35.206 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:35.208 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:35.208 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:35.208 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 137 k 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:28:35.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:35.210 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 137 k 2024-09-18T10:28:35.210 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 379 k 2024-09-18T10:28:35.210 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:35.402 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-immutable-object-cache-17.2.7-1645.g7061ea 716 kB/s | 137 kB 00:00 2024-09-18T10:28:35.403 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:35.403 INFO:teuthology.orchestra.run.smithi100.stdout:Total 709 kB/s | 137 kB 00:00 2024-09-18T10:28:35.403 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:35.411 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:35.411 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:35.468 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:35.468 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:35.619 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:35.649 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:01 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:35.695 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:35.720 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:35.720 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:35.720 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T10:28:35.720 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:35.780 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:35.781 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-18T10:28:35.781 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:35.781 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-18T10:28:35.781 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:35.781 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 7.4 M 2024-09-18T10:28:35.781 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:35.782 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:35.783 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-18T10:28:35.783 INFO:teuthology.orchestra.run.smithi071.stdout:Install 12 Packages 2024-09-18T10:28:35.783 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:35.783 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 38 M 2024-09-18T10:28:35.783 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 212 M 2024-09-18T10:28:35.783 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:36.047 INFO:teuthology.orchestra.run.smithi071.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-18T10:28:36.106 INFO:teuthology.orchestra.run.smithi071.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.0 MB/s | 801 kB 00:00 2024-09-18T10:28:36.156 INFO:teuthology.orchestra.run.smithi071.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-18T10:28:36.207 INFO:teuthology.orchestra.run.smithi071.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-18T10:28:36.257 INFO:teuthology.orchestra.run.smithi071.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 1/7 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 2/7 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 3/7 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T10:28:36.263 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T10:28:36.352 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 34/34 2024-09-18T10:28:36.352 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/34 2024-09-18T10:28:36.352 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 3/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 4/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 5/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9. 6/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-18T10:28:36.353 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-18T10:28:36.354 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-18T10:28:36.355 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-18T10:28:36.355 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-18T10:28:36.355 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-18T10:28:36.355 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-18T10:28:36.355 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-18T10:28:36.390 INFO:teuthology.orchestra.run.smithi071.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-16 15 MB/s | 7.4 MB 00:00 2024-09-18T10:28:36.548 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T10:28:36.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:36.548 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:36.548 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:36.548 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:36.549 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:36.641 INFO:teuthology.orchestra.run.smithi071.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 979 kB/s | 245 kB 00:00 2024-09-18T10:28:36.670 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:36.670 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:36.670 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:36.670 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:36.670 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:36.670 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:36.716 INFO:teuthology.orchestra.run.smithi071.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.9 MB/s | 3.0 MB 00:00 2024-09-18T10:28:36.753 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T10:28:36.857 INFO:teuthology.orchestra.run.smithi071.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-18T10:28:36.887 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr 2024-09-18T10:28:37.357 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:02 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T10:28:37.425 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T10:28:37.426 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T10:28:37.427 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T10:28:37.428 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:37.428 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:37.483 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:37.494 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 7.4 M 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T10:28:37.496 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:37.497 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-18T10:28:37.498 INFO:teuthology.orchestra.run.smithi063.stdout:Install 12 Packages 2024-09-18T10:28:37.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:37.498 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 38 M 2024-09-18T10:28:37.498 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 212 M 2024-09-18T10:28:37.498 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:37.576 INFO:teuthology.orchestra.run.smithi100.stdout:Package ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:37.621 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:37.622 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:28:37.622 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:37.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T10:28:37.794 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-base 2024-09-18T10:28:38.001 INFO:teuthology.orchestra.run.smithi063.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-18T10:28:38.043 INFO:teuthology.orchestra.run.smithi063.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-18T10:28:38.100 INFO:teuthology.orchestra.run.smithi071.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.7 MB/s | 4.9 MB 00:01 2024-09-18T10:28:38.263 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:00:57 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:38.351 INFO:teuthology.orchestra.run.smithi063.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-18T10:28:38.373 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:38.397 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:38.397 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:38.397 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 3.4 M 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 24 k 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 15 k 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T10:28:38.398 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout:Install 7 Packages 2024-09-18T10:28:38.399 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 3.7 M 2024-09-18T10:28:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 80 M 2024-09-18T10:28:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:38.463 INFO:teuthology.orchestra.run.smithi160.stdout:Package ceph-base-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:38.504 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:38.505 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:28:38.505 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:38.570 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install cephadm 2024-09-18T10:28:38.581 INFO:teuthology.orchestra.run.smithi100.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1645.g706 162 kB/s | 24 kB 00:00 2024-09-18T10:28:38.606 INFO:teuthology.orchestra.run.smithi100.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1645.g7061 83 kB/s | 15 kB 00:00 2024-09-18T10:28:38.624 INFO:teuthology.orchestra.run.smithi071.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-09-18T10:28:38.635 INFO:teuthology.orchestra.run.smithi063.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-09-18T10:28:38.648 INFO:teuthology.orchestra.run.smithi100.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-18T10:28:38.674 INFO:teuthology.orchestra.run.smithi100.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-18T10:28:38.699 INFO:teuthology.orchestra.run.smithi100.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-18T10:28:38.724 INFO:teuthology.orchestra.run.smithi100.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-18T10:28:38.833 INFO:teuthology.orchestra.run.smithi100.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1645.g7061ea6c 8.4 MB/s | 3.4 MB 00:00 2024-09-18T10:28:38.836 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:38.836 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.3 MB/s | 3.7 MB 00:00 2024-09-18T10:28:38.837 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:38.844 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:38.845 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:38.902 INFO:teuthology.orchestra.run.smithi063.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 34 kB/s | 18 kB 00:00 2024-09-18T10:28:38.929 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:38.929 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:39.142 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:39.239 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:39.271 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 83 k 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:39.272 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 83 k 2024-09-18T10:28:39.273 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 375 k 2024-09-18T10:28:39.273 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:28:39.301 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T10:28:39.327 INFO:teuthology.orchestra.run.smithi063.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-09-18T10:28:39.334 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T10:28:39.352 INFO:teuthology.orchestra.run.smithi063.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 54 kB/s | 38 kB 00:00 2024-09-18T10:28:39.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T10:28:39.422 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T10:28:39.458 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 5/7 2024-09-18T10:28:39.473 INFO:teuthology.orchestra.run.smithi160.stdout:cephadm-17.2.7-1645.g7061ea6c.el9.noarch.rpm 414 kB/s | 83 kB 00:00 2024-09-18T10:28:39.473 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:39.473 INFO:teuthology.orchestra.run.smithi160.stdout:Total 411 kB/s | 83 kB 00:00 2024-09-18T10:28:39.474 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:28:39.478 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:28:39.479 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:28:39.480 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:28:39.481 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:28:39.556 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:28:39.973 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:40.042 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:40.144 INFO:teuthology.orchestra.run.smithi063.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.0 MB/s | 4.9 MB 00:01 2024-09-18T10:28:40.169 INFO:teuthology.orchestra.run.smithi063.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-09-18T10:28:40.427 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:40.451 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 6/7 2024-09-18T10:28:40.496 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:40.603 INFO:teuthology.orchestra.run.smithi063.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-18T10:28:40.680 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:28:40.681 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:40.681 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:40.681 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:40.681 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:40.681 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:40.893 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T10:28:41.045 INFO:teuthology.orchestra.run.smithi063.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 278 kB/s | 250 kB 00:00 2024-09-18T10:28:41.488 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:41.609 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:41.610 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 1/7 2024-09-18T10:28:41.610 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 2/7 2024-09-18T10:28:41.610 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 3/7 2024-09-18T10:28:41.610 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T10:28:41.610 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T10:28:41.610 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T10:28:41.622 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:41.622 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:41.622 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-09-18T10:28:41.622 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:41.622 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:28:41.622 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 137 k 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 137 k 2024-09-18T10:28:41.623 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 379 k 2024-09-18T10:28:41.624 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:28:41.770 INFO:teuthology.orchestra.run.smithi063.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-18T10:28:41.771 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:41.772 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.9 MB/s | 38 MB 00:04 2024-09-18T10:28:41.829 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-immutable-object-cache-17.2.7-1645.g7061ea 671 kB/s | 137 kB 00:00 2024-09-18T10:28:41.830 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:41.830 INFO:teuthology.orchestra.run.smithi160.stdout:Total 664 kB/s | 137 kB 00:00 2024-09-18T10:28:41.830 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:28:41.837 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:28:41.837 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:28:41.888 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T10:28:41.888 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:41.888 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:41.889 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:41.893 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:28:41.893 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:28:42.047 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:28:42.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T10:28:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:42.143 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:42.163 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:42.164 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:28:42.164 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T10:28:42.164 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:42.170 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:42.171 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:42.687 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:01 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:42.720 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:42.721 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:42.820 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 7.4 M 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T10:28:42.821 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-09-18T10:28:42.822 INFO:teuthology.orchestra.run.smithi100.stdout:Install 12 Packages 2024-09-18T10:28:42.823 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:42.823 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 38 M 2024-09-18T10:28:42.823 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 212 M 2024-09-18T10:28:42.823 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:43.158 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c. 1/1 2024-09-18T10:28:43.158 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:43.158 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:43.158 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:28:43.158 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:43.158 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:43.274 INFO:teuthology.orchestra.run.smithi100.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-18T10:28:43.316 INFO:teuthology.orchestra.run.smithi100.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 782 kB/s | 33 kB 00:00 2024-09-18T10:28:43.377 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr 2024-09-18T10:28:43.424 INFO:teuthology.orchestra.run.smithi100.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-18T10:28:43.466 INFO:teuthology.orchestra.run.smithi100.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-18T10:28:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:43.583 INFO:teuthology.orchestra.run.smithi100.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-16 15 MB/s | 7.4 MB 00:00 2024-09-18T10:28:43.593 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T10:28:43.609 INFO:teuthology.orchestra.run.smithi100.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-18T10:28:43.635 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:43.692 INFO:teuthology.orchestra.run.smithi100.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-18T10:28:43.743 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:43.834 INFO:teuthology.orchestra.run.smithi100.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.8 MB/s | 3.0 MB 00:00 2024-09-18T10:28:43.878 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T10:28:43.918 INFO:teuthology.orchestra.run.smithi100.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-18T10:28:43.966 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:44.058 INFO:teuthology.orchestra.run.smithi160.stdout:Package ceph-mgr-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:28:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T10:28:44.093 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T10:28:44.101 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:44.102 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:28:44.102 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:44.172 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T10:28:44.174 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T10:28:44.535 INFO:teuthology.orchestra.run.smithi100.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 5.2 MB/s | 4.9 MB 00:00 2024-09-18T10:28:44.707 INFO:teuthology.orchestra.run.smithi071.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-18T10:28:44.708 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:44.708 INFO:teuthology.orchestra.run.smithi071.stdout:Total 4.3 MB/s | 38 MB 00:08 2024-09-18T10:28:44.763 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:44.768 INFO:teuthology.orchestra.run.smithi100.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.7 MB/s | 5.1 MB 00:01 2024-09-18T10:28:44.882 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T10:28:44.894 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:44.895 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:44.895 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 3.4 M 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 24 k 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 15 k 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T10:28:44.896 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout:Install 7 Packages 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 3.7 M 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 80 M 2024-09-18T10:28:44.897 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:28:45.003 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T10:28:45.063 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:45.090 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:45.241 INFO:teuthology.orchestra.run.smithi160.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1645.g706 155 kB/s | 24 kB 00:00 2024-09-18T10:28:45.266 INFO:teuthology.orchestra.run.smithi160.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1645.g7061 80 kB/s | 15 kB 00:00 2024-09-18T10:28:45.308 INFO:teuthology.orchestra.run.smithi160.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-18T10:28:45.337 INFO:teuthology.orchestra.run.smithi160.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-18T10:28:45.358 INFO:teuthology.orchestra.run.smithi160.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-18T10:28:45.392 INFO:teuthology.orchestra.run.smithi160.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-18T10:28:45.501 INFO:teuthology.orchestra.run.smithi160.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1645.g7061ea6c 8.0 MB/s | 3.4 MB 00:00 2024-09-18T10:28:45.505 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:45.505 INFO:teuthology.orchestra.run.smithi160.stdout:Total 6.0 MB/s | 3.7 MB 00:00 2024-09-18T10:28:45.505 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:28:45.513 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:28:45.513 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:28:45.613 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:28:45.614 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:28:45.617 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:45.617 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:45.911 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:28:45.977 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T10:28:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T10:28:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T10:28:46.089 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T10:28:46.110 INFO:teuthology.orchestra.run.smithi100.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-09-18T10:28:46.111 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:46.111 INFO:teuthology.orchestra.run.smithi100.stdout:Total 12 MB/s | 38 MB 00:03 2024-09-18T10:28:46.118 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 5/7 2024-09-18T10:28:46.373 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:46.374 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:46.443 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T10:28:46.467 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:46.494 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:46.494 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:46.497 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:46.596 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:46.639 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T10:28:46.824 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T10:28:46.855 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T10:28:46.931 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T10:28:47.011 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:47.011 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:47.118 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 6/7 2024-09-18T10:28:47.155 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:47.451 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T10:28:47.474 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:47.592 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T10:28:47.710 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T10:28:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:47.833 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T10:28:47.883 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:47.981 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:48.026 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T10:28:48.211 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T10:28:48.250 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T10:28:48.254 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 7/7 2024-09-18T10:28:48.255 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9. 1/7 2024-09-18T10:28:48.255 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarc 2/7 2024-09-18T10:28:48.255 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.n 3/7 2024-09-18T10:28:48.255 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T10:28:48.255 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T10:28:48.255 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T10:28:48.335 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T10:28:48.538 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T10:28:48.538 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:48.538 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:48.538 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:48.539 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:48.539 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:48.539 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T10:28:48.539 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T10:28:48.539 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T10:28:48.539 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T10:28:48.540 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:48.540 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:48.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T10:28:48.944 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:48.987 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T10:28:49.105 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T10:28:49.330 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:01 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:28:49.462 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:28:49.463 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-18T10:28:49.463 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 7.4 M 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T10:28:49.464 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout:Install 12 Packages 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:49.465 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 38 M 2024-09-18T10:28:49.466 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 212 M 2024-09-18T10:28:49.466 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:28:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T10:28:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:50.008 INFO:teuthology.orchestra.run.smithi160.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 17 MB/s | 7.4 MB 00:00 2024-09-18T10:28:50.083 INFO:teuthology.orchestra.run.smithi160.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 442 kB/s | 33 kB 00:00 2024-09-18T10:28:50.137 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 1/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T10:28:50.259 INFO:teuthology.orchestra.run.smithi160.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 17 MB/s | 3.0 MB 00:00 2024-09-18T10:28:50.300 INFO:teuthology.orchestra.run.smithi160.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 439 kB/s | 18 kB 00:00 2024-09-18T10:28:50.342 INFO:teuthology.orchestra.run.smithi160.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 922 kB/s | 38 kB 00:00 2024-09-18T10:28:50.379 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:50.501 INFO:teuthology.orchestra.run.smithi160.stdout:(6/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 31 MB/s | 4.9 MB 00:00 2024-09-18T10:28:50.526 INFO:teuthology.orchestra.run.smithi160.stdout:(7/12): libquadmath-11.5.0-2.el9.x86_64.rpm 202 kB/s | 191 kB 00:00 2024-09-18T10:28:50.547 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T10:28:50.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:50.547 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:50.547 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:50.548 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:50.551 INFO:teuthology.orchestra.run.smithi160.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-18T10:28:50.594 INFO:teuthology.orchestra.run.smithi160.stdout:(9/12): libgfortran-11.5.0-2.el9.x86_64.rpm 792 kB/s | 801 kB 00:01 2024-09-18T10:28:50.619 INFO:teuthology.orchestra.run.smithi160.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 3.7 MB/s | 250 kB 00:00 2024-09-18T10:28:50.844 INFO:teuthology.orchestra.run.smithi160.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-18T10:28:50.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-rook 2024-09-18T10:28:51.203 INFO:teuthology.orchestra.run.smithi160.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-18T10:28:51.204 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:51.204 INFO:teuthology.orchestra.run.smithi160.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-18T10:28:51.417 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T10:28:51.450 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:51.534 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:16 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:51.557 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:28:51.583 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:28:51.583 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:28:51.675 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 47 k 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T10:28:51.677 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2024-09-18T10:28:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:51.679 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 2.2 M 2024-09-18T10:28:51.679 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 26 M 2024-09-18T10:28:51.679 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:52.089 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:28:52.090 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:28:52.224 INFO:teuthology.orchestra.run.smithi063.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 254 kB/s | 19 kB 00:00 2024-09-18T10:28:52.240 INFO:teuthology.orchestra.run.smithi063.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 276 kB/s | 26 kB 00:00 2024-09-18T10:28:52.299 INFO:teuthology.orchestra.run.smithi063.stdout:(3/13): ceph-mgr-rook-17.2.7-1645.g7061ea6c.el9 313 kB/s | 47 kB 00:00 2024-09-18T10:28:52.307 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:52.307 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 1/12 2024-09-18T10:28:52.307 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:52.308 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T10:28:52.324 INFO:teuthology.orchestra.run.smithi063.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-18T10:28:52.350 INFO:teuthology.orchestra.run.smithi063.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-18T10:28:52.375 INFO:teuthology.orchestra.run.smithi063.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-18T10:28:52.417 INFO:teuthology.orchestra.run.smithi063.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 339 kB/s | 14 kB 00:00 2024-09-18T10:28:52.467 INFO:teuthology.orchestra.run.smithi063.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 275 kB/s | 32 kB 00:00 2024-09-18T10:28:52.501 INFO:teuthology.orchestra.run.smithi063.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-18T10:28:52.526 INFO:teuthology.orchestra.run.smithi063.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-18T10:28:52.560 INFO:teuthology.orchestra.run.smithi063.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-18T10:28:52.602 INFO:teuthology.orchestra.run.smithi063.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 585 kB/s | 59 kB 00:00 2024-09-18T10:28:52.635 INFO:teuthology.orchestra.run.smithi063.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-18T10:28:52.638 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:52.638 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-18T10:28:52.704 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:52.720 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:52.720 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:52.767 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T10:28:52.767 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:52.767 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:52.767 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:52.767 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:52.768 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:52.817 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:52.817 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:52.852 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:28:52.944 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T10:28:52.992 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:53.104 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:53.144 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T10:28:53.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-rook 2024-09-18T10:28:53.330 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T10:28:53.339 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:28:53.367 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T10:28:53.444 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T10:28:53.524 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T10:28:53.580 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T10:28:53.644 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T10:28:53.679 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T10:28:53.722 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T10:28:53.822 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:19 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:53.835 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T10:28:53.954 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T10:28:53.955 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:53.956 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:53.956 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:53.956 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:53.956 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:53.956 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 47 k 2024-09-18T10:28:53.956 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T10:28:53.957 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout:Install 13 Packages 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.2 M 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 26 M 2024-09-18T10:28:53.958 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:54.007 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T10:28:54.151 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T10:28:54.188 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 1/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:54.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T10:28:54.266 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T10:28:54.327 INFO:teuthology.orchestra.run.smithi071.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 211 kB/s | 19 kB 00:00 2024-09-18T10:28:54.353 INFO:teuthology.orchestra.run.smithi071.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 220 kB/s | 26 kB 00:00 2024-09-18T10:28:54.411 INFO:teuthology.orchestra.run.smithi071.stdout:(3/13): ceph-mgr-rook-17.2.7-1645.g7061ea6c.el9 271 kB/s | 47 kB 00:00 2024-09-18T10:28:54.445 INFO:teuthology.orchestra.run.smithi071.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-18T10:28:54.470 INFO:teuthology.orchestra.run.smithi071.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-18T10:28:54.487 INFO:teuthology.orchestra.run.smithi071.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.2 MB/s | 54 kB 00:00 2024-09-18T10:28:54.529 INFO:teuthology.orchestra.run.smithi071.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 551 kB/s | 32 kB 00:00 2024-09-18T10:28:54.546 INFO:teuthology.orchestra.run.smithi071.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 241 kB/s | 14 kB 00:00 2024-09-18T10:28:54.571 INFO:teuthology.orchestra.run.smithi071.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-09-18T10:28:54.605 INFO:teuthology.orchestra.run.smithi071.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.8 MB/s | 220 kB 00:00 2024-09-18T10:28:54.619 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T10:28:54.619 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:54.620 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:54.621 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T10:28:54.621 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:54.621 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:54.630 INFO:teuthology.orchestra.run.smithi071.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-18T10:28:54.655 INFO:teuthology.orchestra.run.smithi071.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-18T10:28:54.689 INFO:teuthology.orchestra.run.smithi071.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-18T10:28:54.691 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:54.691 INFO:teuthology.orchestra.run.smithi071.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-18T10:28:54.754 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:28:54.767 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T10:28:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:28:54.769 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:28:54.820 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T10:28:54.853 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T10:28:54.858 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:28:54.859 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:28:54.908 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T10:28:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:28:54.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-rook 2024-09-18T10:28:55.364 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:28:55.536 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T10:28:55.571 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:14 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:28:55.573 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:55.606 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T10:28:55.670 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T10:28:55.704 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:28:55.705 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:28:55.705 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:55.705 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 47 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T10:28:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2024-09-18T10:28:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:55.708 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T10:28:55.708 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.2 M 2024-09-18T10:28:55.708 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 26 M 2024-09-18T10:28:55.708 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:28:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 1/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T10:28:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T10:28:55.749 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T10:28:55.858 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T10:28:55.958 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 196 kB/s | 26 kB 00:00 2024-09-18T10:28:55.968 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T10:28:55.983 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 123 kB/s | 19 kB 00:00 2024-09-18T10:28:56.009 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): ceph-mgr-rook-17.2.7-1645.g7061ea6c.el9 262 kB/s | 47 kB 00:00 2024-09-18T10:28:56.026 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T10:28:56.054 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:56.055 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:28:56.126 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-18T10:28:56.151 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-18T10:28:56.185 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-18T10:28:56.218 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-18T10:28:56.244 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-18T10:28:56.269 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-18T10:28:56.311 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-18T10:28:56.318 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T10:28:56.336 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 987 kB/s | 59 kB 00:00 2024-09-18T10:28:56.361 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-18T10:28:56.470 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2024-09-18T10:28:56.473 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:56.473 INFO:teuthology.orchestra.run.smithi100.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-18T10:28:56.539 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:28:56.554 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:28:56.554 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:28:56.615 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T10:28:56.641 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:28:56.642 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:28:56.649 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T10:28:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T10:28:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T10:28:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T10:28:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:28:56.924 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:28:57.063 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:28:57.064 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:57.064 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:28:57.064 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:57.064 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 124 k 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2024-09-18T10:28:57.065 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:28:57.066 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 7.0 M 2024-09-18T10:28:57.066 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 33 M 2024-09-18T10:28:57.066 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:28:57.173 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:28:57.333 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T10:28:57.388 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T10:28:57.443 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T10:28:57.470 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1645.g7061ea6c.e 642 kB/s | 124 kB 00:00 2024-09-18T10:28:57.480 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T10:28:57.503 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-18T10:28:57.522 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T10:28:57.562 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-18T10:28:57.604 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.0 MB/s | 548 kB 00:00 2024-09-18T10:28:57.623 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T10:28:57.629 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-18T10:28:57.725 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T10:28:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 1/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T10:28:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T10:28:57.782 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T10:28:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T10:28:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:58.098 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:28:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:58.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T10:28:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T10:28:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T10:28:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T10:28:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T10:28:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T10:28:58.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T10:28:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T10:28:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T10:28:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T10:28:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T10:28:58.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T10:28:58.101 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:58.101 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:28:58.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T10:28:58.495 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T10:28:58.546 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T10:28:58.580 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T10:28:58.625 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T10:28:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:28:58.950 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:24 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:28:59.082 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:28:59.082 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 124 k 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:28:59.083 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:28:59.084 INFO:teuthology.orchestra.run.smithi071.stdout:Install 6 Packages 2024-09-18T10:28:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:28:59.084 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 7.0 M 2024-09-18T10:28:59.084 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 33 M 2024-09-18T10:28:59.084 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:28:59.140 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 12/12 2024-09-18T10:28:59.140 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061e 1/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T10:28:59.141 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 1/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T10:28:59.438 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T10:28:59.439 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T10:28:59.439 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T10:28:59.439 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T10:28:59.439 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T10:28:59.539 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:28:59.540 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:28:59.688 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-09-18T10:28:59.692 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:28:59.693 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-18T10:28:59.767 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:28:59.780 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:28:59.780 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:28:59.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T10:28:59.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T10:28:59.789 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T10:28:59.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T10:28:59.790 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T10:28:59.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:28:59.790 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:28:59.885 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:28:59.886 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:28:59.924 INFO:teuthology.orchestra.run.smithi071.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1645.g7061ea6c.e 636 kB/s | 124 kB 00:00 2024-09-18T10:28:59.950 INFO:teuthology.orchestra.run.smithi071.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-18T10:28:59.962 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-rook 2024-09-18T10:29:00.000 INFO:teuthology.orchestra.run.smithi071.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-18T10:29:00.017 INFO:teuthology.orchestra.run.smithi071.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 865 kB/s | 58 kB 00:00 2024-09-18T10:29:00.042 INFO:teuthology.orchestra.run.smithi071.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-18T10:29:00.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T10:29:00.207 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:00.427 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T10:29:00.433 INFO:teuthology.orchestra.run.smithi071.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.5 MB/s | 6.0 MB 00:00 2024-09-18T10:29:00.436 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:00.436 INFO:teuthology.orchestra.run.smithi071.stdout:Total 5.2 MB/s | 7.0 MB 00:01 2024-09-18T10:29:00.491 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T10:29:00.508 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:00.518 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:00.518 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:00.553 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:12 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:00.617 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:00.618 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:00.661 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:19 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:00.689 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 47 k 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T10:29:00.691 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout:Install 13 Packages 2024-09-18T10:29:00.692 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:00.693 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 2.2 M 2024-09-18T10:29:00.693 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 26 M 2024-09-18T10:29:00.693 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:00.794 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 124 k 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T10:29:00.795 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout:Install 6 Packages 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 7.0 M 2024-09-18T10:29:00.796 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 33 M 2024-09-18T10:29:00.797 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:00.928 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:01.045 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T10:29:01.082 INFO:teuthology.orchestra.run.smithi160.stdout:(1/13): ceph-mgr-rook-17.2.7-1645.g7061ea6c.el9 275 kB/s | 47 kB 00:00 2024-09-18T10:29:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T10:29:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T10:29:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T10:29:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T10:29:01.199 INFO:teuthology.orchestra.run.smithi160.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 66 kB/s | 19 kB 00:00 2024-09-18T10:29:01.225 INFO:teuthology.orchestra.run.smithi160.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 81 kB/s | 26 kB 00:00 2024-09-18T10:29:01.226 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:01.332 INFO:teuthology.orchestra.run.smithi100.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-18T10:29:01.381 INFO:teuthology.orchestra.run.smithi100.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-18T10:29:01.406 INFO:teuthology.orchestra.run.smithi100.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-18T10:29:01.431 INFO:teuthology.orchestra.run.smithi100.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-18T10:29:01.532 INFO:teuthology.orchestra.run.smithi100.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-18T10:29:01.575 INFO:teuthology.orchestra.run.smithi160.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-18T10:29:01.632 INFO:teuthology.orchestra.run.smithi100.stdout:(6/6): ceph-mgr-cephadm-17.2.7-1645.g7061ea6c.e 287 kB/s | 124 kB 00:00 2024-09-18T10:29:01.634 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:01.634 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.3 MB/s | 7.0 MB 00:00 2024-09-18T10:29:01.692 INFO:teuthology.orchestra.run.smithi160.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 459 kB/s | 54 kB 00:00 2024-09-18T10:29:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T10:29:01.704 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:01.716 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:01.716 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:01.717 INFO:teuthology.orchestra.run.smithi160.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 566 kB/s | 279 kB 00:00 2024-09-18T10:29:01.759 INFO:teuthology.orchestra.run.smithi160.stdout:(7/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 328 kB/s | 222 kB 00:00 2024-09-18T10:29:01.784 INFO:teuthology.orchestra.run.smithi160.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-18T10:29:01.790 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T10:29:01.814 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:01.814 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:01.818 INFO:teuthology.orchestra.run.smithi160.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-18T10:29:01.843 INFO:teuthology.orchestra.run.smithi160.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-18T10:29:01.853 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T10:29:01.877 INFO:teuthology.orchestra.run.smithi160.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-18T10:29:01.880 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:01.902 INFO:teuthology.orchestra.run.smithi160.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.5 MB/s | 220 kB 00:00 2024-09-18T10:29:01.945 INFO:teuthology.orchestra.run.smithi160.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.7 MB/s | 1.0 MB 00:00 2024-09-18T10:29:01.946 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:01.947 INFO:teuthology.orchestra.run.smithi160.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-09-18T10:29:01.982 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:01.982 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/6 2024-09-18T10:29:01.982 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T10:29:01.982 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T10:29:01.982 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T10:29:01.982 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T10:29:02.013 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:02.028 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:02.028 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:02.119 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:02.119 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:02.140 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:02.269 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:02.270 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:02.308 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T10:29:02.359 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T10:29:02.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-fuse 2024-09-18T10:29:02.664 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/6 2024-09-18T10:29:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T10:29:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T10:29:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T10:29:02.689 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T10:29:02.835 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T10:29:02.894 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T10:29:02.903 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T10:29:02.959 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T10:29:02.961 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:02.962 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:02.979 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T10:29:03.004 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T10:29:03.034 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T10:29:03.045 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T10:29:03.063 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:03.106 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:03.147 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T10:29:03.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-fuse 2024-09-18T10:29:03.244 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:03.244 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:03.244 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:29:03.244 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 813 k 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout:Install 2 Packages 2024-09-18T10:29:03.245 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:03.246 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 893 k 2024-09-18T10:29:03.246 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 2.6 M 2024-09-18T10:29:03.246 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:03.250 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T10:29:03.297 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T10:29:03.480 INFO:teuthology.orchestra.run.smithi063.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 822 kB/s | 80 kB 00:00 2024-09-18T10:29:03.769 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:03.797 INFO:teuthology.orchestra.run.smithi063.stdout:(2/2): ceph-fuse-17.2.7-1645.g7061ea6c.el9.x86_ 1.9 MB/s | 813 kB 00:00 2024-09-18T10:29:03.797 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:03.798 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.6 MB/s | 893 kB 00:00 2024-09-18T10:29:03.811 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:03.835 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:03.835 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:03.880 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:03.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/6 2024-09-18T10:29:03.880 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T10:29:03.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T10:29:03.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T10:29:03.881 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T10:29:03.900 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 813 k 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:03.901 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:03.902 INFO:teuthology.orchestra.run.smithi071.stdout:Install 2 Packages 2024-09-18T10:29:03.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:03.902 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 893 k 2024-09-18T10:29:03.902 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 2.6 M 2024-09-18T10:29:03.902 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:03.920 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:03.920 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:04.022 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T10:29:04.069 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T10:29:04.101 INFO:teuthology.orchestra.run.smithi071.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 448 kB/s | 80 kB 00:00 2024-09-18T10:29:04.103 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T10:29:04.112 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:04.148 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T10:29:04.149 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:04.150 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:04.172 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:29:04.252 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T10:29:04.333 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:04.406 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-fuse 2024-09-18T10:29:04.551 INFO:teuthology.orchestra.run.smithi071.stdout:(2/2): ceph-fuse-17.2.7-1645.g7061ea6c.el9.x86_ 1.3 MB/s | 813 kB 00:00 2024-09-18T10:29:04.552 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:04.552 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.3 MB/s | 893 kB 00:00 2024-09-18T10:29:04.564 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:04.586 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:04.586 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:04.665 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:04.665 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:04.878 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:04.984 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:23 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:05.008 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:05.009 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/2 2024-09-18T10:29:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T10:29:05.025 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 13/13 2024-09-18T10:29:05.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 1/13 2024-09-18T10:29:05.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T10:29:05.025 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T10:29:05.026 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T10:29:05.083 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:05.115 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:05.115 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:05.115 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:29:05.115 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 813 k 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout:Install 2 Packages 2024-09-18T10:29:05.116 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:05.117 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 893 k 2024-09-18T10:29:05.117 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 2.6 M 2024-09-18T10:29:05.117 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:05.294 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T10:29:05.295 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:05.295 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:05.295 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T10:29:05.295 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:05.295 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:05.368 INFO:teuthology.orchestra.run.smithi100.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 668 kB/s | 80 kB 00:00 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T10:29:05.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T10:29:05.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T10:29:05.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T10:29:05.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T10:29:05.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T10:29:05.380 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:05.380 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:05.570 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-volume 2024-09-18T10:29:05.653 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T10:29:05.753 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:05.786 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/2 2024-09-18T10:29:05.792 INFO:teuthology.orchestra.run.smithi100.stdout:(2/2): ceph-fuse-17.2.7-1645.g7061ea6c.el9.x86_ 1.5 MB/s | 813 kB 00:00 2024-09-18T10:29:05.793 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:05.793 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.3 MB/s | 893 kB 00:00 2024-09-18T10:29:05.805 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:05.827 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:05.827 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:05.905 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:05.906 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T10:29:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:06.020 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T10:29:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:06.020 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:06.091 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:06.184 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:06.237 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:18 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:06.247 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T10:29:06.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-volume 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 270 k 2024-09-18T10:29:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 270 k 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 1.3 M 2024-09-18T10:29:06.323 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:06.333 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:06.371 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:06.372 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:06.372 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:29:06.372 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:06.372 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:06.372 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 124 k 2024-09-18T10:29:06.372 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout:Install 6 Packages 2024-09-18T10:29:06.373 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:06.374 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 7.0 M 2024-09-18T10:29:06.374 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 33 M 2024-09-18T10:29:06.374 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:06.568 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-volume-17.2.7-1645.g7061ea6c.el9.noarch.rp 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:06.569 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:06.569 INFO:teuthology.orchestra.run.smithi063.stdout:Total 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:06.569 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:06.578 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:06.578 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:06.613 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:06.613 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:06.796 INFO:teuthology.orchestra.run.smithi160.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1645.g7061ea6c.e 609 kB/s | 124 kB 00:00 2024-09-18T10:29:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-18T10:29:06.874 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:06.880 INFO:teuthology.orchestra.run.smithi160.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-18T10:29:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:06.905 INFO:teuthology.orchestra.run.smithi160.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-18T10:29:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:06.920 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:06.920 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T10:29:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:06.991 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:06.991 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/2 2024-09-18T10:29:07.011 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:07.011 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:07.011 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 270 k 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 270 k 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 1.3 M 2024-09-18T10:29:07.012 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:07.038 INFO:teuthology.orchestra.run.smithi160.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 557 kB/s | 248 kB 00:00 2024-09-18T10:29:07.257 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-volume-17.2.7-1645.g7061ea6c.el9.noarch.rp 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:07.257 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:07.257 INFO:teuthology.orchestra.run.smithi071.stdout:Total 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:07.257 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:07.265 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:07.265 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:07.272 INFO:teuthology.orchestra.run.smithi160.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.8 MB/s | 6.0 MB 00:00 2024-09-18T10:29:07.274 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:07.275 INFO:teuthology.orchestra.run.smithi160.stdout:Total 7.8 MB/s | 7.0 MB 00:00 2024-09-18T10:29:07.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T10:29:07.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:07.283 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:07.283 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T10:29:07.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:07.283 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:07.293 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:07.293 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:07.349 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:07.360 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:07.360 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:07.459 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:07.460 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:07.504 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:07.574 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:07.590 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:07.591 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:07.591 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T10:29:07.591 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:07.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-volume 2024-09-18T10:29:07.772 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:07.935 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:07.935 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:07.935 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:07.935 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:07.935 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:07.935 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:07.940 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T10:29:07.999 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T10:29:08.225 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:08.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados-devel 2024-09-18T10:29:08.363 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 270 k 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:08.364 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:08.365 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:08.365 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:29:08.365 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:08.365 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 270 k 2024-09-18T10:29:08.365 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 1.3 M 2024-09-18T10:29:08.365 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:08.533 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T10:29:08.597 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-volume-17.2.7-1645.g7061ea6c.el9.noarch.rp 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:08.598 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:08.598 INFO:teuthology.orchestra.run.smithi100.stdout:Total 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:08.598 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:08.607 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:08.607 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:08.618 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T10:29:08.638 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:08.639 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:08.644 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:08.644 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:08.645 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:08.645 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:08.645 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:08.645 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:08.673 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T10:29:08.703 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:08.844 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:08.853 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:08.916 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:08.932 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:08.933 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:08.933 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T10:29:08.933 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:08.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados-devel 2024-09-18T10:29:08.981 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 126 k 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:29:08.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:08.983 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 126 k 2024-09-18T10:29:08.983 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 448 k 2024-09-18T10:29:08.983 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:09.165 INFO:teuthology.orchestra.run.smithi063.stdout:librados-devel-17.2.7-1645.g7061ea6c.el9.x86_64 696 kB/s | 126 kB 00:00 2024-09-18T10:29:09.165 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:09.165 INFO:teuthology.orchestra.run.smithi063.stdout:Total 691 kB/s | 126 kB 00:00 2024-09-18T10:29:09.165 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:09.171 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:09.171 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:09.238 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:09.238 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:09.393 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:09.490 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:09.493 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 6/6 2024-09-18T10:29:09.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 1/6 2024-09-18T10:29:09.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T10:29:09.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T10:29:09.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T10:29:09.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T10:29:09.546 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:09.679 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:09.679 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:09.679 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-18T10:29:09.679 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 126 k 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 126 k 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 448 k 2024-09-18T10:29:09.680 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:09.767 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T10:29:09.767 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:09.768 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:09.885 INFO:teuthology.orchestra.run.smithi071.stdout:librados-devel-17.2.7-1645.g7061ea6c.el9.x86_64 616 kB/s | 126 kB 00:00 2024-09-18T10:29:09.886 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:09.886 INFO:teuthology.orchestra.run.smithi071.stdout:Total 612 kB/s | 126 kB 00:00 2024-09-18T10:29:09.886 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:09.891 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:09.892 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:09.922 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:09.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:09.934 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:09.934 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:09.954 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:09.954 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:10.027 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-fuse 2024-09-18T10:29:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:10.194 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:10.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:10.194 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:10.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados-devel 2024-09-18T10:29:10.442 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs2 2024-09-18T10:29:10.611 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:22 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:10.614 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:10.745 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 813 k 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:10.746 INFO:teuthology.orchestra.run.smithi160.stdout:Install 2 Packages 2024-09-18T10:29:10.747 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:10.747 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 893 k 2024-09-18T10:29:10.747 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 2.6 M 2024-09-18T10:29:10.747 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:10.881 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:10.901 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:10.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:10.901 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:10.901 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:10.901 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:10.901 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:11.014 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:11.015 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:11.015 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T10:29:11.015 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:11.015 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 126 k 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 126 k 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 448 k 2024-09-18T10:29:11.016 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:11.024 INFO:teuthology.orchestra.run.smithi160.stdout:(1/2): ceph-fuse-17.2.7-1645.g7061ea6c.el9.x86_ 3.1 MB/s | 813 kB 00:00 2024-09-18T10:29:11.052 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:11.144 INFO:teuthology.orchestra.run.smithi063.stdout:Package libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:11.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs2 2024-09-18T10:29:11.189 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:11.190 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:11.191 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:11.228 INFO:teuthology.orchestra.run.smithi100.stdout:librados-devel-17.2.7-1645.g7061ea6c.el9.x86_64 598 kB/s | 126 kB 00:00 2024-09-18T10:29:11.228 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:11.228 INFO:teuthology.orchestra.run.smithi100.stdout:Total 594 kB/s | 126 kB 00:00 2024-09-18T10:29:11.229 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:11.234 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:11.234 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:11.249 INFO:teuthology.orchestra.run.smithi160.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 166 kB/s | 80 kB 00:00 2024-09-18T10:29:11.249 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:11.250 INFO:teuthology.orchestra.run.smithi160.stdout:Total 1.7 MB/s | 893 kB 00:00 2024-09-18T10:29:11.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs-devel 2024-09-18T10:29:11.262 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:11.284 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:11.284 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:11.296 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:11.296 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:11.362 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:11.363 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:11.448 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:11.548 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:11.559 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:11.702 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T10:29:11.745 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:11.780 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:11.838 INFO:teuthology.orchestra.run.smithi071.stdout:Package libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:11.863 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:11.883 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:11.884 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:11.884 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:11.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install libcephfs-devel 2024-09-18T10:29:12.001 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:12.002 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 25 k 2024-09-18T10:29:12.003 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 110 k 2024-09-18T10:29:12.003 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:12.046 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:12.159 INFO:teuthology.orchestra.run.smithi063.stdout:libcephfs-devel-17.2.7-1645.g7061ea6c.el9.x86_6 160 kB/s | 25 kB 00:00 2024-09-18T10:29:12.159 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:12.160 INFO:teuthology.orchestra.run.smithi063.stdout:Total 158 kB/s | 25 kB 00:00 2024-09-18T10:29:12.160 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:12.163 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:12.164 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:12.165 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:12.165 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:12.244 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:12.298 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:12.298 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:12.298 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:12.299 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:12.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:12.299 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:12.359 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:12.461 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2/2 2024-09-18T10:29:12.461 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/2 2024-09-18T10:29:12.533 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:12.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs2 2024-09-18T10:29:12.665 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:12.666 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:12.667 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:12.667 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:29:12.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:12.667 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 25 k 2024-09-18T10:29:12.667 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 110 k 2024-09-18T10:29:12.667 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:12.735 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T10:29:12.735 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:12.736 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:12.736 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T10:29:12.736 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:12.736 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:12.743 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:12.821 INFO:teuthology.orchestra.run.smithi071.stdout:libcephfs-devel-17.2.7-1645.g7061ea6c.el9.x86_6 162 kB/s | 25 kB 00:00 2024-09-18T10:29:12.822 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:12.822 INFO:teuthology.orchestra.run.smithi071.stdout:Total 160 kB/s | 25 kB 00:00 2024-09-18T10:29:12.822 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:12.825 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:12.825 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:12.827 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:12.827 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:12.975 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:12.975 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:12.976 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:13.018 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:13.113 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-volume 2024-09-18T10:29:13.143 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:13.157 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados2 2024-09-18T10:29:13.234 INFO:teuthology.orchestra.run.smithi100.stdout:Package libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:13.277 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:13.278 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:13.278 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:13.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install libcephfs-devel 2024-09-18T10:29:13.382 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:13.608 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:13.608 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:13.608 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:13.718 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:13.760 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:13.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librados2 2024-09-18T10:29:13.853 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:13.858 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:13.858 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:13.858 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-18T10:29:13.858 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:13.858 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:13.858 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:17.2.7-1645.g7061ea6c.el9 ceph-noarch 270 k 2024-09-18T10:29:13.859 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:13.859 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:13.859 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:13.859 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:29:13.859 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:13.859 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 270 k 2024-09-18T10:29:13.860 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 1.3 M 2024-09-18T10:29:13.860 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:13.898 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:13.900 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:13.900 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:13.943 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:13.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librbd1 2024-09-18T10:29:14.074 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:14.075 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:14.075 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T10:29:14.075 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:14.075 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:14.075 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 25 k 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 110 k 2024-09-18T10:29:14.076 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:14.095 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-volume-17.2.7-1645.g7061ea6c.el9.noarch.rp 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:14.096 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:14.096 INFO:teuthology.orchestra.run.smithi160.stdout:Total 1.1 MB/s | 270 kB 00:00 2024-09-18T10:29:14.096 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:14.105 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:14.105 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:14.131 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:14.131 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:libcephfs-devel-17.2.7-1645.g7061ea6c.el9.x86_6 170 kB/s | 25 kB 00:00 2024-09-18T10:29:14.224 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:14.224 INFO:teuthology.orchestra.run.smithi100.stdout:Total 168 kB/s | 25 kB 00:00 2024-09-18T10:29:14.224 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:14.227 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:14.228 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:14.229 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:14.229 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:14.344 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:14.380 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:14.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:14.414 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:14.414 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:14.414 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-18T10:29:14.414 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:14.469 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:14.511 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:14.512 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:14.512 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:14.567 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:14.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install librbd1 2024-09-18T10:29:14.660 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:14.705 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:14.706 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:14.706 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:14.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rados 2024-09-18T10:29:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:15.039 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:15.040 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:15.156 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:15.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librados2 2024-09-18T10:29:15.244 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:15.287 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:15.288 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:15.288 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:15.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rados 2024-09-18T10:29:15.381 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:15.442 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 1/1 2024-09-18T10:29:15.442 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:15.442 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:15.442 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:17.2.7-1645.g7061ea6c.el9.noarch 2024-09-18T10:29:15.442 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:15.442 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:15.474 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:15.519 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:15.520 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:15.520 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:15.588 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rgw 2024-09-18T10:29:15.720 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install librados-devel 2024-09-18T10:29:15.819 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:15.908 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:15.945 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:15.950 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:15.951 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:15.951 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:16.007 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install librbd1 2024-09-18T10:29:16.034 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:16.077 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:16.078 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:16.078 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:16.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rgw 2024-09-18T10:29:16.192 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:16.285 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:16.322 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:16.331 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:16.332 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:16.332 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:16.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-cephfs 2024-09-18T10:29:16.455 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 126 k 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:16.456 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 126 k 2024-09-18T10:29:16.457 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 448 k 2024-09-18T10:29:16.457 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:16.585 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:16.667 INFO:teuthology.orchestra.run.smithi160.stdout:librados-devel-17.2.7-1645.g7061ea6c.el9.x86_64 600 kB/s | 126 kB 00:00 2024-09-18T10:29:16.668 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:16.668 INFO:teuthology.orchestra.run.smithi160.stdout:Total 595 kB/s | 126 kB 00:00 2024-09-18T10:29:16.668 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:16.673 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:16.673 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:16.673 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:16.716 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:16.717 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:16.717 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:16.727 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:16.737 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:16.737 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:16.784 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rados 2024-09-18T10:29:16.816 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:16.860 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:16.890 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:16.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-cephfs 2024-09-18T10:29:16.996 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:17.007 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:17.088 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:17.134 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:17.135 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:17.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rbd 2024-09-18T10:29:17.362 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:17.451 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:17.457 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:17.493 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:17.494 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:17.495 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:17.509 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:17.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rgw 2024-09-18T10:29:17.599 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:17.641 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:17.643 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:17.643 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:17.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install python3-rbd 2024-09-18T10:29:17.752 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:17.752 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:17.752 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:17.752 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:17.752 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:17.752 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:17.813 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:17.906 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:17.951 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:17.952 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-09-18T10:29:17.952 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:17.982 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install libcephfs2 2024-09-18T10:29:18.014 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-fuse 2024-09-18T10:29:18.132 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:18.220 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:18.263 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:18.264 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:18.264 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:18.298 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:44 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:18.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-cephfs 2024-09-18T10:29:18.387 INFO:teuthology.orchestra.run.smithi071.stdout:Package python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:18.431 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:18.432 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2024-09-18T10:29:18.432 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:18.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-fuse 2024-09-18T10:29:18.572 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:18.619 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:18.662 INFO:teuthology.orchestra.run.smithi160.stdout:Package libcephfs2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:18.706 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:18.707 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:18.707 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:18.762 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:18.762 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:18.762 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 82 k 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 82 k 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 222 k 2024-09-18T10:29:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:18.788 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install libcephfs-devel 2024-09-18T10:29:18.914 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:18.954 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-fuse-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 429 kB/s | 82 kB 00:00 2024-09-18T10:29:18.955 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:18.955 INFO:teuthology.orchestra.run.smithi063.stdout:Total 426 kB/s | 82 kB 00:00 2024-09-18T10:29:18.955 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:18.962 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:18.962 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:19.003 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:19.030 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:19.030 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:19.045 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:19.046 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:19.047 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:19.094 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:45 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:19.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install python3-rbd 2024-09-18T10:29:19.184 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 82 k 2024-09-18T10:29:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 82 k 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 222 k 2024-09-18T10:29:19.230 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:19.279 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:19.370 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:19.416 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-fuse-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 440 kB/s | 82 kB 00:00 2024-09-18T10:29:19.417 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:19.417 INFO:teuthology.orchestra.run.smithi071.stdout:Total 437 kB/s | 82 kB 00:00 2024-09-18T10:29:19.417 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:19.423 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:19.424 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:19.488 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:19.488 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:19.503 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:19.504 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:19.504 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-09-18T10:29:19.505 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:19.505 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:19.505 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 25 k 2024-09-18T10:29:19.505 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:19.505 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:19.505 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:19.506 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:29:19.506 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:19.506 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 25 k 2024-09-18T10:29:19.506 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 110 k 2024-09-18T10:29:19.506 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:19.646 INFO:teuthology.orchestra.run.smithi160.stdout:libcephfs-devel-17.2.7-1645.g7061ea6c.el9.x86_6 175 kB/s | 25 kB 00:00 2024-09-18T10:29:19.647 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:19.647 INFO:teuthology.orchestra.run.smithi160.stdout:Total 174 kB/s | 25 kB 00:00 2024-09-18T10:29:19.647 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:19.648 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:19.650 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:19.650 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:19.652 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:19.652 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:19.708 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:19.736 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:19.746 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:19.799 INFO:teuthology.orchestra.run.smithi100.stdout:Package python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:19.841 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:19.843 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-09-18T10:29:19.843 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:19.876 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:19.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-fuse 2024-09-18T10:29:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:19.960 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:19.960 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:20.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-mirror 2024-09-18T10:29:20.248 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:20.375 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:20.375 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:20.493 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:20.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:20.498 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:20.498 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:20.499 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:20.499 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:20.499 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:20.623 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 82 k 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:20.624 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:20.625 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:29:20.625 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:20.625 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 82 k 2024-09-18T10:29:20.625 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 222 k 2024-09-18T10:29:20.625 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:20.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-mirror 2024-09-18T10:29:20.677 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install librados2 2024-09-18T10:29:20.813 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:45 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:20.818 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-fuse-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 424 kB/s | 82 kB 00:00 2024-09-18T10:29:20.818 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:20.819 INFO:teuthology.orchestra.run.smithi100.stdout:Total 421 kB/s | 82 kB 00:00 2024-09-18T10:29:20.819 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:20.825 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:20.825 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:20.889 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:20.889 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:20.950 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:29:20.951 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:20.952 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 2.9 M 2024-09-18T10:29:20.952 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 12 M 2024-09-18T10:29:20.952 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:21.045 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:21.245 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:47 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:21.258 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:21.274 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-mirror-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 9.1 MB/s | 2.9 MB 00:00 2024-09-18T10:29:21.275 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:21.275 INFO:teuthology.orchestra.run.smithi063.stdout:Total 9.1 MB/s | 2.9 MB 00:00 2024-09-18T10:29:21.275 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:21.285 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:21.285 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:21.347 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:21.369 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:21.370 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:21.381 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:29:21.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:21.383 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 2.9 M 2024-09-18T10:29:21.383 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 12 M 2024-09-18T10:29:21.383 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:21.390 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:21.391 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:21.391 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:21.460 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install librbd1 2024-09-18T10:29:21.524 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:21.718 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-mirror-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 8.8 MB/s | 2.9 MB 00:00 2024-09-18T10:29:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.7 MB/s | 2.9 MB 00:00 2024-09-18T10:29:21.719 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:21.728 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:21.778 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:21.778 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:21.778 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:21.778 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:21.779 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:21.779 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:21.808 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:21.808 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:21.810 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:21.875 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:21.906 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:21.907 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:21.907 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T10:29:21.907 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:21.907 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:21.907 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:22.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-mirror 2024-09-18T10:29:22.043 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:22.132 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:22.175 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:22.176 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:22.177 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:22.221 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:22.238 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-rados 2024-09-18T10:29:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:22.318 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:22.318 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T10:29:22.318 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:22.319 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:22.618 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:41 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repo Size 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:29:22.752 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 2.9 M 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 12 M 2024-09-18T10:29:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:22.817 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:22.907 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-rados-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:22.949 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:22.950 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:22.950 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:23.018 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:23.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:23.018 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:23.018 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:23.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:23.018 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:23.019 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-rgw 2024-09-18T10:29:23.088 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-mirror-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 8.8 MB/s | 2.9 MB 00:00 2024-09-18T10:29:23.089 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:23.089 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.7 MB/s | 2.9 MB 00:00 2024-09-18T10:29:23.090 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:23.098 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:23.098 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:23.177 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:23.178 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:23.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-nbd 2024-09-18T10:29:23.409 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:23.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:23.410 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:23.410 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:23.410 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:23.410 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:23.592 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:23.594 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:23.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install rbd-nbd 2024-09-18T10:29:23.656 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:23.681 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:23.681 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:23.682 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T10:29:23.682 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:23.682 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:23.682 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:23.682 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-rgw-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:23.724 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:23.725 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:23.725 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:23.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-cephfs 2024-09-18T10:29:23.879 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:48 ago on Wed 18 Sep 2024 10:27:35 AM UTC. 2024-09-18T10:29:24.016 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-18T10:29:24.016 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 165 k 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-09-18T10:29:24.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:24.018 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 165 k 2024-09-18T10:29:24.018 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 477 k 2024-09-18T10:29:24.018 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-18T10:29:24.220 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-nbd-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 818 kB/s | 165 kB 00:00 2024-09-18T10:29:24.220 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:24.221 INFO:teuthology.orchestra.run.smithi063.stdout:Total 812 kB/s | 165 kB 00:00 2024-09-18T10:29:24.221 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-18T10:29:24.229 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-18T10:29:24.229 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-18T10:29:24.246 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:50 ago on Wed 18 Sep 2024 10:27:34 AM UTC. 2024-09-18T10:29:24.296 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-18T10:29:24.297 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-18T10:29:24.379 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:24.381 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 165 k 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-18T10:29:24.382 INFO:teuthology.orchestra.run.smithi071.stdout:Install 1 Package 2024-09-18T10:29:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 165 k 2024-09-18T10:29:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 477 k 2024-09-18T10:29:24.383 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-18T10:29:24.456 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-18T10:29:24.468 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-cephfs-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:24.511 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:24.512 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:24.561 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:24.582 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install python3-rbd 2024-09-18T10:29:24.596 INFO:teuthology.orchestra.run.smithi071.stdout:rbd-nbd-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 776 kB/s | 165 kB 00:00 2024-09-18T10:29:24.596 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:24.597 INFO:teuthology.orchestra.run.smithi071.stdout:Total 770 kB/s | 165 kB 00:00 2024-09-18T10:29:24.597 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-18T10:29:24.604 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-18T10:29:24.604 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-18T10:29:24.667 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-18T10:29:24.667 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-18T10:29:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:24.806 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:24.806 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:24.821 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-18T10:29:24.927 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:24.976 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:25.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install rbd-nbd 2024-09-18T10:29:25.166 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:25.256 INFO:teuthology.orchestra.run.smithi160.stdout:Package python3-rbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 is already installed. 2024-09-18T10:29:25.259 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:25.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:25.259 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-18T10:29:25.259 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:25.259 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:25.260 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-18T10:29:25.299 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:25.300 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-09-18T10:29:25.300 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:25.366 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install rbd-fuse 2024-09-18T10:29:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:25.481 DEBUG:teuthology.parallel:result is None 2024-09-18T10:29:25.646 INFO:teuthology.orchestra.run.smithi100.stdout:Last metadata expiration check: 0:01:44 ago on Wed 18 Sep 2024 10:27:41 AM UTC. 2024-09-18T10:29:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:25.648 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-18T10:29:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:25.648 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:25.648 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-18T10:29:25.779 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-18T10:29:25.779 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 165 k 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:Install 1 Package 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 165 k 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 477 k 2024-09-18T10:29:25.780 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-18T10:29:25.924 DEBUG:teuthology.parallel:result is None 2024-09-18T10:29:25.943 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:25.984 INFO:teuthology.orchestra.run.smithi100.stdout:rbd-nbd-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 810 kB/s | 165 kB 00:00 2024-09-18T10:29:25.985 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:25.985 INFO:teuthology.orchestra.run.smithi100.stdout:Total 805 kB/s | 165 kB 00:00 2024-09-18T10:29:25.986 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-18T10:29:25.993 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-18T10:29:25.993 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-18T10:29:26.056 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-18T10:29:26.056 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-18T10:29:26.074 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:26.074 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:26.074 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:26.074 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:26.074 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:26.074 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 82 k 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 82 k 2024-09-18T10:29:26.075 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 222 k 2024-09-18T10:29:26.076 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:26.208 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-18T10:29:26.274 INFO:teuthology.orchestra.run.smithi160.stdout:rbd-fuse-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 413 kB/s | 82 kB 00:00 2024-09-18T10:29:26.274 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:26.274 INFO:teuthology.orchestra.run.smithi160.stdout:Total 411 kB/s | 82 kB 00:00 2024-09-18T10:29:26.274 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:26.281 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:26.281 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:26.323 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:26.343 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:26.343 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:26.492 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:26.595 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:26.796 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:27.014 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:27.040 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:27.040 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:27.040 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-18T10:29:27.041 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:27.041 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:27.041 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-18T10:29:27.265 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:27.265 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:27.265 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:27.266 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:27.266 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:27.266 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:27.303 DEBUG:teuthology.parallel:result is None 2024-09-18T10:29:27.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install rbd-mirror 2024-09-18T10:29:28.145 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:40 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:28.281 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repo Size 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 2.9 M 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:28.282 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:28.283 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:29:28.283 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:28.283 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 2.9 M 2024-09-18T10:29:28.283 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 12 M 2024-09-18T10:29:28.283 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:28.611 INFO:teuthology.orchestra.run.smithi160.stdout:rbd-mirror-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 9.0 MB/s | 2.9 MB 00:00 2024-09-18T10:29:28.611 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:28.611 INFO:teuthology.orchestra.run.smithi160.stdout:Total 8.9 MB/s | 2.9 MB 00:00 2024-09-18T10:29:28.612 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:28.620 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:28.620 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:28.699 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:28.699 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:29.107 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:29.186 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:29.210 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:29.211 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T10:29:29.211 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T10:29:29.211 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:29.211 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T10:29:29.211 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:30.340 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:30.340 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:30.340 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:30.341 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:30.341 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:30.341 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:30.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install rbd-nbd 2024-09-18T10:29:31.220 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:43 ago on Wed 18 Sep 2024 10:27:48 AM UTC. 2024-09-18T10:29:31.355 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:17.2.7-1645.g7061ea6c.el9 ceph 165 k 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout:Install 1 Package 2024-09-18T10:29:31.356 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:31.357 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 165 k 2024-09-18T10:29:31.357 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 477 k 2024-09-18T10:29:31.357 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-18T10:29:31.556 INFO:teuthology.orchestra.run.smithi160.stdout:rbd-nbd-17.2.7-1645.g7061ea6c.el9.x86_64.rpm 829 kB/s | 165 kB 00:00 2024-09-18T10:29:31.557 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-18T10:29:31.557 INFO:teuthology.orchestra.run.smithi160.stdout:Total 822 kB/s | 165 kB 00:00 2024-09-18T10:29:31.557 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-18T10:29:31.564 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-18T10:29:31.564 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-18T10:29:31.628 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-18T10:29:31.628 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-18T10:29:31.782 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-18T10:29:31.886 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:32.323 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:32.564 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 1/1 2024-09-18T10:29:32.564 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:32.564 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-18T10:29:32.564 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:17.2.7-1645.g7061ea6c.el9.x86_64 2024-09-18T10:29:32.564 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:32.564 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-18T10:29:32.843 DEBUG:teuthology.parallel:result is None 2024-09-18T10:29:32.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:29:32.998 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T10:29:33.025 INFO:teuthology.orchestra.run.smithi063.stdout:17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.025 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.025 INFO:teuthology.task.install:The correct ceph version 17.2.7-1645.g7061ea6c is installed. 2024-09-18T10:29:33.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:29:33.171 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T10:29:33.197 INFO:teuthology.orchestra.run.smithi071.stdout:17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.197 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.198 INFO:teuthology.task.install:The correct ceph version 17.2.7-1645.g7061ea6c is installed. 2024-09-18T10:29:33.199 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:29:33.343 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T10:29:33.368 INFO:teuthology.orchestra.run.smithi100.stdout:17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.369 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.369 INFO:teuthology.task.install:The correct ceph version 17.2.7-1645.g7061ea6c is installed. 2024-09-18T10:29:33.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7061ea6ca50908d104e9f3979dc615e118d9e153 2024-09-18T10:29:33.515 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T10:29:33.538 INFO:teuthology.orchestra.run.smithi160.stdout:17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.538 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1645.g7061ea6c.el9 2024-09-18T10:29:33.538 INFO:teuthology.task.install:The correct ceph version 17.2.7-1645.g7061ea6c is installed. 2024-09-18T10:29:33.540 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T10:29:33.540 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:33.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T10:29:33.573 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:33.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T10:29:33.605 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:33.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T10:29:33.636 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:33.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T10:29:33.663 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T10:29:33.663 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:33.664 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T10:29:33.694 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T10:29:33.763 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:33.764 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T10:29:33.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T10:29:33.861 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:33.862 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T10:29:33.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T10:29:33.953 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:33.954 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T10:29:33.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T10:29:34.044 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T10:29:34.045 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:34.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T10:29:34.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T10:29:34.146 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:34.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T10:29:34.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T10:29:34.248 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:34.248 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T10:29:34.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T10:29:34.339 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:34.340 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T10:29:34.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T10:29:34.430 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T10:29:34.430 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:34.430 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T10:29:34.461 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T10:29:34.532 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:34.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T10:29:34.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T10:29:34.630 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:34.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T10:29:34.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T10:29:34.720 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:34.720 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T10:29:34.746 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T10:29:34.811 INFO:teuthology.run_tasks:Running task ceph... 2024-09-18T10:29:34.889 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-18T10:29:34.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-18T10:29:34.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-09-18T10:29:34.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-09-18T10:29:34.897 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2024-09-18T10:29:34.923 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-18T10:29:34.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T10:29:34.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T10:29:34.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T10:29:34.968 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-18T10:29:34.992 INFO:tasks.ceph:Creating extra log directories... 2024-09-18T10:29:34.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T10:29:35.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T10:29:35.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T10:29:35.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-18T10:29:35.086 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-18T10:29:35.086 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-18T10:29:35.086 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874', 'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'description': 'rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'job_id': '7910874', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}}, 'owner': 'scheduled_skanta@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 4631, 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7061ea6ca50908d104e9f3979dc615e118d9e153/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxCE53DzQwTYVEmzRl7NtfuHSyL6PYoCpDs67qkH9u67k/COSvcyocsQLF7U3ctK0JbVdRAfxRFbBA72W0V+Dc=', 'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJR8YFs7eet7ZaGZgESEGqVtNwxhUzZ8cziJ+D8/VJECh+SLLEewcYc5qk0HOWzszM5d/tYPF99ZG6U4R7RFZc4=', 'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpXkQBZfUu/tPgGv2rCxFisGeDKCexoFBRhNasJL64XYuI29uJdTh71yE/h7sitYE9RcHDaYkCoJChhBtKCSMs=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWYqABTWYtnEjq/0XqXEVfJTEgt/zSY27G3cFSrTkhxT6m74j8Fvb0Vj/UBChx5EjIzq6jSz4BwTNE810DurVw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153', 'cluster': 'ceph'}}, {'thrashosds': {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_09:13:00', 'tube': 'smithi', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-18T10:29:35.087 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T10:29:35.109 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T10:29:35.111 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T10:29:35.114 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-18T10:29:35.130 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T10:29:35.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T10:29:35.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T10:29:35.170 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2024-09-18T10:29:35.195 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:35.195 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T10:29:35.248 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T10:29:35.248 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-18T10:29:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T10:29:35.305 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-18 10:29:22.173848931 +0000 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-18 10:26:48.008688826 +0000 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-18 10:26:48.008688826 +0000 2024-09-18T10:29:35.306 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-18 10:26:48.008688826 +0000 2024-09-18T10:29:35.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T10:29:35.371 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-18T10:29:35.371 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-18T10:29:35.371 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000263235 s, 1.9 MB/s 2024-09-18T10:29:35.372 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T10:29:35.429 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-18T10:29:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-18 10:29:22.173848931 +0000 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-18 10:26:48.364685590 +0000 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-18 10:26:48.364685590 +0000 2024-09-18T10:29:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-18 10:26:48.364685590 +0000 2024-09-18T10:29:35.487 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T10:29:35.552 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-18T10:29:35.552 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-18T10:29:35.552 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000198058 s, 2.6 MB/s 2024-09-18T10:29:35.553 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T10:29:35.610 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-18T10:29:35.666 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T10:29:35.666 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:35.666 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T10:29:35.667 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:35.667 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:35.667 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-18 10:29:22.173848931 +0000 2024-09-18T10:29:35.667 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-18 10:26:48.705682490 +0000 2024-09-18T10:29:35.667 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-18 10:26:48.705682490 +0000 2024-09-18T10:29:35.667 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-18 10:26:48.705682490 +0000 2024-09-18T10:29:35.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T10:29:35.730 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-18T10:29:35.730 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-18T10:29:35.731 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000206057 s, 2.5 MB/s 2024-09-18T10:29:35.732 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T10:29:35.789 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-18T10:29:35.845 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T10:29:35.845 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-18 10:29:22.174848921 +0000 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-18 10:26:49.044679409 +0000 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-18 10:26:49.044679409 +0000 2024-09-18T10:29:35.846 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-18 10:26:49.044679409 +0000 2024-09-18T10:29:35.846 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T10:29:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-18T10:29:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-18T10:29:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000230352 s, 2.2 MB/s 2024-09-18T10:29:35.914 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T10:29:35.971 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:35.971 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:35.971 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T10:29:35.990 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T10:29:35.991 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-18T10:29:36.050 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T10:29:36.050 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:36.050 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-18T10:29:36.050 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:36.050 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:36.050 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-18 10:29:22.567333731 +0000 2024-09-18T10:29:36.051 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-18 10:26:46.353387782 +0000 2024-09-18T10:29:36.051 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-18 10:26:46.353387782 +0000 2024-09-18T10:29:36.051 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-18 10:26:46.353387782 +0000 2024-09-18T10:29:36.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T10:29:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-18T10:29:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-18T10:29:36.117 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00023628 s, 2.2 MB/s 2024-09-18T10:29:36.119 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T10:29:36.178 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-18T10:29:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T10:29:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:36.235 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T10:29:36.235 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:36.235 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:36.235 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-18 10:29:22.567333731 +0000 2024-09-18T10:29:36.236 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-18 10:26:46.675382037 +0000 2024-09-18T10:29:36.236 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-18 10:26:46.675382037 +0000 2024-09-18T10:29:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-18 10:26:46.675382037 +0000 2024-09-18T10:29:36.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T10:29:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-18T10:29:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-18T10:29:36.300 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000195097 s, 2.6 MB/s 2024-09-18T10:29:36.302 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T10:29:36.360 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-18T10:29:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T10:29:36.416 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:36.416 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T10:29:36.416 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:36.416 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:36.417 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-18 10:29:22.568333713 +0000 2024-09-18T10:29:36.417 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-18 10:26:47.001376216 +0000 2024-09-18T10:29:36.417 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-18 10:26:47.001376216 +0000 2024-09-18T10:29:36.417 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-18 10:26:47.001376216 +0000 2024-09-18T10:29:36.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T10:29:36.481 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-18T10:29:36.481 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-18T10:29:36.481 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000224328 s, 2.3 MB/s 2024-09-18T10:29:36.482 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T10:29:36.539 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-18 10:29:22.568333713 +0000 2024-09-18T10:29:36.595 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-18 10:26:47.333370289 +0000 2024-09-18T10:29:36.596 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-18 10:26:47.333370289 +0000 2024-09-18T10:29:36.596 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-18 10:26:47.333370289 +0000 2024-09-18T10:29:36.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T10:29:36.659 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-18T10:29:36.659 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-18T10:29:36.659 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00021174 s, 2.4 MB/s 2024-09-18T10:29:36.660 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T10:29:36.717 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:36.717 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:36.717 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T10:29:36.737 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T10:29:36.738 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-18T10:29:36.799 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T10:29:36.799 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:36.799 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T10:29:36.799 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:36.799 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:36.800 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 10:29:23.933775543 +0000 2024-09-18T10:29:36.800 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 10:26:52.912414023 +0000 2024-09-18T10:29:36.800 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 10:26:52.912414023 +0000 2024-09-18T10:29:36.800 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 10:26:52.912414023 +0000 2024-09-18T10:29:36.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T10:29:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T10:29:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T10:29:36.866 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000278039 s, 1.8 MB/s 2024-09-18T10:29:36.867 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T10:29:36.928 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-18T10:29:36.985 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 10:29:23.933775543 +0000 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 10:26:53.240405588 +0000 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 10:26:53.240405588 +0000 2024-09-18T10:29:36.986 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 10:26:53.240405588 +0000 2024-09-18T10:29:36.986 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T10:29:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T10:29:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T10:29:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000269533 s, 1.9 MB/s 2024-09-18T10:29:37.053 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T10:29:37.111 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-18T10:29:37.169 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T10:29:37.169 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:37.169 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-18T10:29:37.170 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:37.170 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:37.170 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 10:29:23.933775543 +0000 2024-09-18T10:29:37.170 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 10:26:53.571397076 +0000 2024-09-18T10:29:37.170 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 10:26:53.571397076 +0000 2024-09-18T10:29:37.170 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 10:26:53.571397076 +0000 2024-09-18T10:29:37.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T10:29:37.233 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T10:29:37.233 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T10:29:37.233 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000176286 s, 2.9 MB/s 2024-09-18T10:29:37.235 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T10:29:37.294 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-18T10:29:37.352 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T10:29:37.353 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:37.353 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T10:29:37.353 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:37.353 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:37.353 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-18 10:29:23.934775517 +0000 2024-09-18T10:29:37.354 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-18 10:26:53.888388923 +0000 2024-09-18T10:29:37.354 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-18 10:26:53.888388923 +0000 2024-09-18T10:29:37.354 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-18 10:26:53.888388923 +0000 2024-09-18T10:29:37.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T10:29:37.417 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-18T10:29:37.417 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-18T10:29:37.417 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000180896 s, 2.8 MB/s 2024-09-18T10:29:37.418 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T10:29:37.474 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:37.474 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:37.474 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T10:29:37.494 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T10:29:37.494 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-18 10:29:29.451976893 +0000 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-18 10:26:46.658671695 +0000 2024-09-18T10:29:37.553 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-18 10:26:46.658671695 +0000 2024-09-18T10:29:37.554 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-18 10:26:46.658671695 +0000 2024-09-18T10:29:37.554 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T10:29:37.621 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-18T10:29:37.621 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-18T10:29:37.621 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000363097 s, 1.4 MB/s 2024-09-18T10:29:37.622 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T10:29:37.682 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-09-18T10:29:37.739 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T10:29:37.739 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:37.739 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-18T10:29:37.740 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:37.740 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:37.740 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-18 10:29:29.451976893 +0000 2024-09-18T10:29:37.740 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-18 10:26:46.990666742 +0000 2024-09-18T10:29:37.740 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-18 10:26:46.990666742 +0000 2024-09-18T10:29:37.740 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-18 10:26:46.990666742 +0000 2024-09-18T10:29:37.740 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T10:29:37.807 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-18T10:29:37.807 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-18T10:29:37.807 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000201538 s, 2.5 MB/s 2024-09-18T10:29:37.809 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T10:29:37.869 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-18 10:29:29.452976878 +0000 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-18 10:26:47.338661551 +0000 2024-09-18T10:29:37.927 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-18 10:26:47.338661551 +0000 2024-09-18T10:29:37.928 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-18 10:26:47.338661551 +0000 2024-09-18T10:29:37.928 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T10:29:37.993 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-18T10:29:37.993 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-18T10:29:37.993 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.00019522 s, 2.6 MB/s 2024-09-18T10:29:37.994 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T10:29:38.053 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-18 10:29:29.452976878 +0000 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-18 10:26:47.655656822 +0000 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-18 10:26:47.655656822 +0000 2024-09-18T10:29:38.111 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-18 10:26:47.655656822 +0000 2024-09-18T10:29:38.112 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T10:29:38.181 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-18T10:29:38.182 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-18T10:29:38.182 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000193989 s, 2.6 MB/s 2024-09-18T10:29:38.182 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T10:29:38.239 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:38.239 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-18T10:29:38.239 INFO:tasks.ceph:Generating config... 2024-09-18T10:29:38.240 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-18T10:29:38.240 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-18T10:29:38.240 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.1 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-18T10:29:38.241 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-18T10:29:38.242 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-18T10:29:38.242 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-18T10:29:38.242 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-18T10:29:38.242 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-09-18T10:29:38.242 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2024-09-18T10:29:38.242 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2024-09-18T10:29:38.243 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2024-09-18T10:29:38.243 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-18T10:29:38.243 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-18T10:29:38.243 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-18T10:29:38.243 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-18T10:29:38.243 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-18T10:29:38.243 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-18T10:29:38.243 INFO:tasks.ceph:Setting up mon.a... 2024-09-18T10:29:38.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-18T10:29:38.435 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-09-18T10:29:38.439 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-18T10:29:38.486 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T10:29:38.514 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.71'), ('mon.c', '172.21.15.100')] 2024-09-18T10:29:38.515 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.71,172.21.15.100', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2024-09-18T10:29:38.517 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:38.517 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T10:29:38.572 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.71 --add c 172.21.15.100 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:38.657 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = octopus 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:fsid f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-18T10:29:38.657308+0000 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-18T10:29:38.657308+0000 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 15 (octopus) 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 3 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-09-18T10:29:38.658 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-18T10:29:38.660 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-18T10:29:38.676 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f10241a9-9f2d-4ca9-8e5f-6c8b84917f59... 2024-09-18T10:29:38.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T10:29:38.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T10:29:38.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T10:29:38.724 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-18T10:29:38.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T10:29:38.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-18T10:29:38.764 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.764 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T10:29:38.764 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-18T10:29:38.765 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.766 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.71,172.21.15.100" 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: mon client directed command retry = 5 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: mon election default strategy = 3 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject socket failures = 2500 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: ms tcp read timeout = 5 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: osd_recovery_max_active = 10 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: osd_recovery_max_single_start = 10 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.767 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 120 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-18T10:29:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: debug monc = 20 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-18T10:29:38.769 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore compression algorithm = lz4 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore compression mode = aggressive 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore zero block detection = True 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-18T10:29:38.770 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-18T10:29:38.771 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug reject backfill probability = 0.1 2024-09-18T10:29:38.771 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify cached snaps = True 2024-09-18T10:29:38.771 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify missing on start = True 2024-09-18T10:29:38.771 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-18T10:29:38.771 INFO:teuthology.orchestra.run.smithi063.stdout: osd max backfills = 3 2024-09-18T10:29:38.771 INFO:teuthology.orchestra.run.smithi063.stdout: osd max markdown count = 1000 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock override recovery settings = True 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: osd op queue = debug_random 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: osd op queue cut off = debug_random 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub min interval = 60 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: osd shutdown pgref assert = True 2024-09-18T10:29:38.772 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.773 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-18T10:29:38.774 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T10:29:38.775 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T10:29:38.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.776 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T10:29:38.776 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T10:29:38.776 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T10:29:38.777 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.777 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-18T10:29:38.777 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-18T10:29:38.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.778 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-18T10:29:38.778 INFO:teuthology.orchestra.run.smithi063.stdout: mon scrub interval = 300 2024-09-18T10:29:38.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:29:38.778 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-18T10:29:38.778 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-18T10:29:38.779 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-18T10:29:38.779 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-18T10:29:38.779 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T10:29:38.779 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T10:29:38.779 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-18T10:29:38.779 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-09-18T10:29:38.780 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-09-18T10:29:38.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-09-18T10:29:38.782 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.783 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.784 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.63,172.21.15.71,172.21.15.100" 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: mon client directed command retry = 5 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: mon election default strategy = 3 2024-09-18T10:29:38.785 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject socket failures = 2500 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: ms tcp read timeout = 5 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd_recovery_max_active = 10 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd_recovery_max_single_start = 10 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 120 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-09-18T10:29:38.786 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-09-18T10:29:38.787 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: debug monc = 20 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore compression algorithm = lz4 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore compression mode = aggressive 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore zero block detection = True 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2024-09-18T10:29:38.788 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug reject backfill probability = 0.1 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify cached snaps = True 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify missing on start = True 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd max backfills = 3 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd max markdown count = 1000 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock override recovery settings = True 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-09-18T10:29:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: osd op queue = debug_random 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: osd op queue cut off = debug_random 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub min interval = 60 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: osd shutdown pgref assert = True 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.790 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T10:29:38.791 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: mon scrub interval = 300 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-09-18T10:29:38.792 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2024-09-18T10:29:38.793 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.794 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T10:29:38.795 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.63,172.21.15.71,172.21.15.100" 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: mon client directed command retry = 5 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: mon election default strategy = 3 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: ms inject socket failures = 2500 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: ms tcp read timeout = 5 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: osd_recovery_max_active = 10 2024-09-18T10:29:38.796 INFO:teuthology.orchestra.run.smithi160.stdout: osd_recovery_max_single_start = 10 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 120 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.797 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2024-09-18T10:29:38.798 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: debug monc = 20 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore compression algorithm = lz4 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore compression mode = aggressive 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore zero block detection = True 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2024-09-18T10:29:38.799 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug reject backfill probability = 0.1 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify cached snaps = True 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify missing on start = True 2024-09-18T10:29:38.800 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd max backfills = 3 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd max markdown count = 1000 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock override recovery settings = True 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd op queue = debug_random 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd op queue cut off = debug_random 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub min interval = 60 2024-09-18T10:29:38.801 INFO:teuthology.orchestra.run.smithi160.stdout: osd shutdown pgref assert = True 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.802 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T10:29:38.803 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: mon scrub interval = 300 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2024-09-18T10:29:38.804 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-09-18T10:29:38.805 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-09-18T10:29:38.806 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-09-18T10:29:38.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-09-18T10:29:38.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-09-18T10:29:38.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.63,172.21.15.71,172.21.15.100" 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon client directed command retry = 5 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon election default strategy = 3 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject socket failures = 2500 2024-09-18T10:29:38.810 INFO:teuthology.orchestra.run.smithi071.stdout: ms tcp read timeout = 5 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: osd_recovery_max_active = 10 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: osd_recovery_max_single_start = 10 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-09-18T10:29:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 120 2024-09-18T10:29:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-09-18T10:29:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-09-18T10:29:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-09-18T10:29:38.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.813 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-09-18T10:29:38.813 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-09-18T10:29:38.815 INFO:teuthology.orchestra.run.smithi071.stdout: debug monc = 20 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore compression algorithm = lz4 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore compression mode = aggressive 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore zero block detection = True 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 20 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 20 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-18T10:29:38.816 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 10 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug reject backfill probability = 0.1 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify cached snaps = True 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify missing on start = True 2024-09-18T10:29:38.817 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd max backfills = 3 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd max markdown count = 1000 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock override recovery settings = True 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd op queue = debug_random 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd op queue cut off = debug_random 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub min interval = 60 2024-09-18T10:29:38.818 INFO:teuthology.orchestra.run.smithi071.stdout: osd shutdown pgref assert = True 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.819 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-18T10:29:38.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-09-18T10:29:38.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: mon scrub interval = 300 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-18T10:29:38.822 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-09-18T10:29:38.823 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-09-18T10:29:38.823 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-09-18T10:29:38.825 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-18T10:29:38.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-18T10:29:38.915 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-18T10:29:38.916 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:38.916 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-18T10:29:38.932 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:38.932 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-18T10:29:38.987 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:29:38.988 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:38.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T10:29:38.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T10:29:39.064 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:29:39.064 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:39.120 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:29:39.120 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:39.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T10:29:39.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T10:29:39.162 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:29:39.162 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:39.219 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:29:39.220 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:39.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T10:29:39.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T10:29:39.262 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:29:39.262 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:39.319 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:29:39.320 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:39.320 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-18T10:29:39.320 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-18T10:29:39.359 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:29:39.360 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:39.418 INFO:tasks.ceph:Setting up mon nodes... 2024-09-18T10:29:39.418 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-18T10:29:39.418 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-18T10:29:39.468 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-18T10:29:39.470 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T10:29:39.532 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-18T10:29:39.534 INFO:tasks.ceph:Setting up mds nodes... 2024-09-18T10:29:39.534 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-18T10:29:39.535 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T10:29:39.572 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-18T10:29:39.585 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-18T10:29:39.585 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-18T10:29:39.585 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-18T10:29:39.611 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:39.611 INFO:tasks.ceph:role: osd.0 2024-09-18T10:29:39.612 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:29:39.612 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T10:29:39.685 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:39.686 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:40.190 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-18T10:29:40.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-18T10:29:40.192 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-18T10:29:40.334 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-18T10:29:40.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-18T10:29:40.436 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:40.436 INFO:tasks.ceph:role: osd.4 2024-09-18T10:29:40.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:29:40.436 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:40.509 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:40.953 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-18T10:29:40.955 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-18T10:29:40.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-18T10:29:41.048 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-18T10:29:41.078 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-09-18T10:29:41.144 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:41.144 INFO:tasks.ceph:role: osd.8 2024-09-18T10:29:41.144 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:29:41.144 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:41.218 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:41.697 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-18T10:29:41.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-18T10:29:41.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-09-18T10:29:41.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-09-18T10:29:41.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2024-09-18T10:29:41.942 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:41.942 INFO:tasks.ceph:role: osd.12 2024-09-18T10:29:41.942 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:29:41.942 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:42.015 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:42.016 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:42.537 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-18T10:29:42.540 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-18T10:29:42.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2024-09-18T10:29:42.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2024-09-18T10:29:42.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:42.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:42.823+0000 7f7cb168b440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-18T10:29:42.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:42.823+0000 7f7cb168b440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-18T10:29:42.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:42.823+0000 7f7cb168b440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T10:29:42.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:42.823+0000 7f7cb168b440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T10:29:42.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:42.823+0000 7f7cb168b440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-18T10:29:42.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:42.824+0000 7f7cb168b440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-18T10:29:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:43.349+0000 7f7cb168b440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:44.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:44.121+0000 7f7cb168b440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:44.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:44.884+0000 7f7cb168b440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:45.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T10:29:45.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:45.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:45.796+0000 7fd172c65440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-18T10:29:45.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:45.796+0000 7fd172c65440 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-18T10:29:45.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:45.796+0000 7fd172c65440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T10:29:45.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:45.796+0000 7fd172c65440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T10:29:45.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:45.796+0000 7fd172c65440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-18T10:29:45.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:45.797+0000 7fd172c65440 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-18T10:29:46.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:46.320+0000 7fd172c65440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:47.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:47.083+0000 7fd172c65440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:47.845+0000 7fd172c65440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:48.639 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T10:29:48.669 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:48.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:48.756+0000 7ff70454f440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-09-18T10:29:48.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:48.757+0000 7ff70454f440 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-09-18T10:29:48.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:48.757+0000 7ff70454f440 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-09-18T10:29:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:48.757+0000 7ff70454f440 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-09-18T10:29:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:48.757+0000 7ff70454f440 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-09-18T10:29:48.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:48.757+0000 7ff70454f440 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-09-18T10:29:49.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:49.289+0000 7ff70454f440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:50.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:50.061+0000 7ff70454f440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:50.827+0000 7ff70454f440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:51.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-09-18T10:29:51.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:51.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:51.738+0000 7f255c20a440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2024-09-18T10:29:51.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:51.738+0000 7f255c20a440 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2024-09-18T10:29:51.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:51.738+0000 7f255c20a440 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-09-18T10:29:51.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:51.738+0000 7f255c20a440 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-09-18T10:29:51.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:51.738+0000 7f255c20a440 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-09-18T10:29:51.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:51.739+0000 7f255c20a440 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2024-09-18T10:29:52.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:52.267+0000 7f255c20a440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:53.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:53.033+0000 7f255c20a440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:53.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:29:53.798+0000 7f255c20a440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:54.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2024-09-18T10:29:54.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-18T10:29:54.660 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:54.660 INFO:tasks.ceph:role: osd.1 2024-09-18T10:29:54.660 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:29:54.660 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:54.737 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:55.250 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-18T10:29:55.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-18T10:29:55.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-18T10:29:55.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-18T10:29:55.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-18T10:29:55.480 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:55.480 INFO:tasks.ceph:role: osd.5 2024-09-18T10:29:55.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:29:55.480 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:55.554 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:55.555 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:56.009 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-18T10:29:56.011 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-18T10:29:56.011 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-18T10:29:56.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-18T10:29:56.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-09-18T10:29:56.190 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:56.190 INFO:tasks.ceph:role: osd.9 2024-09-18T10:29:56.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:29:56.191 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T10:29:56.263 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:56.263 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:56.263 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:56.263 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:56.263 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:56.264 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:56.264 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:56.264 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:56.264 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:56.264 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:56.746 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-18T10:29:56.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-18T10:29:56.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2024-09-18T10:29:56.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-09-18T10:29:56.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2024-09-18T10:29:56.983 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-18T10:29:57.036 INFO:tasks.ceph:role: osd.13 2024-09-18T10:29:57.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:29:57.037 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T10:29:57.069 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:29:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:29:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:29:57.069 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:29:57.069 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:29:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:29:57.070 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:29:57.070 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:29:57.070 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:29:57.070 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:29:57.596 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-18T10:29:57.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-18T10:29:57.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2024-09-18T10:29:57.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2024-09-18T10:29:57.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:29:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:57.886+0000 7fe71d82d440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-18T10:29:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:57.887+0000 7fe71d82d440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-18T10:29:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:57.887+0000 7fe71d82d440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T10:29:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:57.887+0000 7fe71d82d440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T10:29:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:57.887+0000 7fe71d82d440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-18T10:29:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:57.887+0000 7fe71d82d440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-18T10:29:58.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:58.411+0000 7fe71d82d440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:59.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:59.177+0000 7fe71d82d440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:29:59.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:29:59.940+0000 7fe71d82d440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:00.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T10:30:00.762 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:00.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:00.844+0000 7f45ce816440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-18T10:30:00.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:00.845+0000 7f45ce816440 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-18T10:30:00.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:00.845+0000 7f45ce816440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T10:30:00.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:00.845+0000 7f45ce816440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T10:30:00.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:00.845+0000 7f45ce816440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-18T10:30:00.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:00.845+0000 7f45ce816440 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-18T10:30:01.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:01.369+0000 7f45ce816440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:02.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:02.132+0000 7f45ce816440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:02.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:02.894+0000 7f45ce816440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:03.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T10:30:03.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:03.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:03.842+0000 7f2abb014440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-09-18T10:30:03.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:03.842+0000 7f2abb014440 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-09-18T10:30:03.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:03.842+0000 7f2abb014440 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-09-18T10:30:03.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:03.842+0000 7f2abb014440 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-09-18T10:30:03.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:03.842+0000 7f2abb014440 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-09-18T10:30:03.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:03.843+0000 7f2abb014440 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-09-18T10:30:04.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:04.374+0000 7f2abb014440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:05.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:05.135+0000 7f2abb014440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:05.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:05.897+0000 7f2abb014440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:06.693 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-09-18T10:30:06.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:06.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:06.801+0000 7f34d3d64440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2024-09-18T10:30:06.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:06.801+0000 7f34d3d64440 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2024-09-18T10:30:06.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:06.801+0000 7f34d3d64440 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-09-18T10:30:06.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:06.801+0000 7f34d3d64440 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-09-18T10:30:06.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:06.801+0000 7f34d3d64440 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-09-18T10:30:06.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:06.802+0000 7f34d3d64440 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2024-09-18T10:30:07.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:07.327+0000 7f34d3d64440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:08.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:08.092+0000 7f34d3d64440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:08.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:30:08.854+0000 7f34d3d64440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:09.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2024-09-18T10:30:09.722 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-18T10:30:09.755 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:09.755 INFO:tasks.ceph:role: osd.2 2024-09-18T10:30:09.755 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:30:09.755 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T10:30:09.830 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:09.831 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:10.323 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T10:30:10.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T10:30:10.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-18T10:30:10.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-18T10:30:10.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-18T10:30:10.547 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:10.547 INFO:tasks.ceph:role: osd.6 2024-09-18T10:30:10.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:30:10.548 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T10:30:10.621 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:10.621 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:10.621 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:10.622 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:11.096 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T10:30:11.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T10:30:11.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2024-09-18T10:30:11.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-18T10:30:11.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-09-18T10:30:11.286 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:11.287 INFO:tasks.ceph:role: osd.10 2024-09-18T10:30:11.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:30:11.287 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T10:30:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:11.360 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:11.852 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T10:30:11.854 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T10:30:11.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2024-09-18T10:30:11.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-09-18T10:30:12.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2024-09-18T10:30:12.079 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:12.079 INFO:tasks.ceph:role: osd.14 2024-09-18T10:30:12.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:30:12.079 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:12.155 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:12.673 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-18T10:30:12.675 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-18T10:30:12.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2024-09-18T10:30:12.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2024-09-18T10:30:12.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:12.948+0000 7f1d3900c440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-18T10:30:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:12.949+0000 7f1d3900c440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-18T10:30:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:12.949+0000 7f1d3900c440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T10:30:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:12.949+0000 7f1d3900c440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T10:30:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:12.949+0000 7f1d3900c440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-18T10:30:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:12.949+0000 7f1d3900c440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-18T10:30:13.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:13.474+0000 7f1d3900c440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:14.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:14.239+0000 7f1d3900c440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:15.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.002+0000 7f1d3900c440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:15.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T10:30:15.831 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.916+0000 7fb70451e440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-18T10:30:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.916+0000 7fb70451e440 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-18T10:30:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.916+0000 7fb70451e440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T10:30:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.916+0000 7fb70451e440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T10:30:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.916+0000 7fb70451e440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-18T10:30:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:15.917+0000 7fb70451e440 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-18T10:30:16.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:16.441+0000 7fb70451e440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:17.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:17.203+0000 7fb70451e440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:17.965+0000 7fb70451e440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:18.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-18T10:30:18.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:18.863+0000 7fd388323440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-09-18T10:30:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:18.863+0000 7fd388323440 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-09-18T10:30:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:18.864+0000 7fd388323440 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-09-18T10:30:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:18.864+0000 7fd388323440 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-09-18T10:30:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:18.864+0000 7fd388323440 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-09-18T10:30:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:18.864+0000 7fd388323440 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-09-18T10:30:19.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:19.389+0000 7fd388323440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:20.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:20.163+0000 7fd388323440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:20.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:20.929+0000 7fd388323440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:21.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-09-18T10:30:21.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:21.886+0000 7fa859c0f440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2024-09-18T10:30:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:21.886+0000 7fa859c0f440 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2024-09-18T10:30:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:21.886+0000 7fa859c0f440 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-09-18T10:30:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:21.886+0000 7fa859c0f440 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-09-18T10:30:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:21.886+0000 7fa859c0f440 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-09-18T10:30:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:21.887+0000 7fa859c0f440 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2024-09-18T10:30:22.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:22.411+0000 7fa859c0f440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:23.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:23.174+0000 7fa859c0f440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:23.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-18T10:30:23.940+0000 7fa859c0f440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:24.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2024-09-18T10:30:24.778 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-18T10:30:24.810 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:24.810 INFO:tasks.ceph:role: osd.3 2024-09-18T10:30:24.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:30:24.810 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-18T10:30:24.887 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:24.888 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:25.404 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-18T10:30:25.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-18T10:30:25.406 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-18T10:30:25.552 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-18T10:30:25.588 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-18T10:30:25.656 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:25.656 INFO:tasks.ceph:role: osd.7 2024-09-18T10:30:25.656 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:30:25.656 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-18T10:30:25.730 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:25.731 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:26.173 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-18T10:30:26.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-18T10:30:26.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2024-09-18T10:30:26.268 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-18T10:30:26.297 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-09-18T10:30:26.364 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:26.364 INFO:tasks.ceph:role: osd.11 2024-09-18T10:30:26.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:30:26.364 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:26.437 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:26.438 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:26.438 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:26.438 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:26.921 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-18T10:30:26.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-18T10:30:26.924 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2024-09-18T10:30:27.071 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-09-18T10:30:27.100 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2024-09-18T10:30:27.166 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-18T10:30:27.166 INFO:tasks.ceph:role: osd.15 2024-09-18T10:30:27.166 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:30:27.166 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-18T10:30:27.238 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-18T10:30:27.239 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-18T10:30:27.239 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-18T10:30:27.239 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-18T10:30:27.760 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-18T10:30:27.762 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-18T10:30:27.763 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2024-09-18T10:30:27.911 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2024-09-18T10:30:27.942 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:28.047 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.045+0000 7f7335721440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-18T10:30:28.047 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.046+0000 7f7335721440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-18T10:30:28.047 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.046+0000 7f7335721440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T10:30:28.047 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.046+0000 7f7335721440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T10:30:28.047 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.046+0000 7f7335721440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-18T10:30:28.048 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.046+0000 7f7335721440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-18T10:30:28.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:28.571+0000 7f7335721440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:29.337 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:29.335+0000 7f7335721440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:30.103 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:30.102+0000 7f7335721440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:30.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T10:30:30.926 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:31.010 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.009+0000 7fa304409440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-18T10:30:31.010 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.009+0000 7fa304409440 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-18T10:30:31.011 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.009+0000 7fa304409440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T10:30:31.011 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.009+0000 7fa304409440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T10:30:31.011 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.009+0000 7fa304409440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-18T10:30:31.011 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.009+0000 7fa304409440 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-18T10:30:31.535 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:31.533+0000 7fa304409440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:32.296 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:32.295+0000 7fa304409440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:33.059 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.058+0000 7fa304409440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:33.860 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-18T10:30:33.889 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:33.977 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.975+0000 7fcadc218440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-09-18T10:30:33.977 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.975+0000 7fcadc218440 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-09-18T10:30:33.977 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.975+0000 7fcadc218440 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-09-18T10:30:33.977 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.975+0000 7fcadc218440 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-09-18T10:30:33.977 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.975+0000 7fcadc218440 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-09-18T10:30:33.977 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:33.976+0000 7fcadc218440 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-09-18T10:30:34.506 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:34.504+0000 7fcadc218440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:35.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:35.269+0000 7fcadc218440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:36.032 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.031+0000 7fcadc218440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:36.827 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-09-18T10:30:36.854 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.939+0000 7ff42280a440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2024-09-18T10:30:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.939+0000 7ff42280a440 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2024-09-18T10:30:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.939+0000 7ff42280a440 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-09-18T10:30:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.939+0000 7ff42280a440 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-09-18T10:30:36.941 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.939+0000 7ff42280a440 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-09-18T10:30:36.942 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:36.940+0000 7ff42280a440 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2024-09-18T10:30:37.467 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:37.464+0000 7ff42280a440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:38.238 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:38.235+0000 7ff42280a440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:39.000 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-18T10:30:38.998+0000 7ff42280a440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-18T10:30:39.799 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2024-09-18T10:30:39.829 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-18T10:30:39.829 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:39.829 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-18T10:30:39.862 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:39.862 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-18T10:30:39.932 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:39.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-18T10:30:40.001 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:40.001 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-09-18T10:30:40.069 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:40.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2024-09-18T10:30:40.136 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:40.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-18T10:30:40.166 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:40.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-18T10:30:40.235 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:40.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-09-18T10:30:40.303 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:40.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2024-09-18T10:30:40.370 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:40.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-18T10:30:40.400 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:40.400 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-18T10:30:40.469 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:40.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-09-18T10:30:40.537 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:40.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2024-09-18T10:30:40.604 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:40.604 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-18T10:30:40.634 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:40.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-18T10:30:40.702 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:40.702 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-18T10:30:40.771 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:40.771 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-09-18T10:30:40.838 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:40.838 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2024-09-18T10:30:40.904 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:40.904 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-18T10:30:40.960 INFO:tasks.ceph:Adding keys to all mons... 2024-09-18T10:30:40.961 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T10:30:40.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T10:30:40.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-18T10:30:40.989 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-09-18T10:30:40.989 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCTq+pmKU/oGxAAng1tU+QoO16WTOMPaJrrZQ== 2024-09-18T10:30:40.989 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-18T10:30:40.989 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCWq+pm3cQlMRAA9GruRtG3t0MP/FCCxmyOtg== 2024-09-18T10:30:40.989 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCZq+pmvpKALxAA4+cKBBAKyg/o1A4Dw7fJJQ== 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.8] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCcq+pmGXcpLRAAcciqHgIbRHR1KkXvQE48rQ== 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.12] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCfq+pm6esPLBAAZoIR31vHRcwE1RsQXmlUWw== 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQClq+pmXprqNBAAPX5pFT7sn4VL/UB1fLPy+g== 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCoq+pmrERtMhAApkD8XIYIfRCJkCojRRGwAQ== 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.9] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCrq+pm94hGMhAAdtOTI4qor6vqW86rxL6vRQ== 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.13] 2024-09-18T10:30:40.990 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCuq+pmPSXYLxAAftgTghg/EQyvMOgBCJpK4g== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQC0q+pmm/2XOBAAyXnRSvycTTfLlOIgb94UQw== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQC3q+pmdUinNhAA9/gPh1Ud/WxCwpsck6Cq6w== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.10] 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQC6q+pmUO+FMxAAQ6Rj37C6lE8RCvZYXX71OQ== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.14] 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQC9q+pmO8LfNBAAXr9rbGMGR8Eydx9p3dAgcQ== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCTq+pmNX20HxAAB6nG86wvZRDdFTxGA7hHew== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDEq+pmqxTKAhAApX1jhCqcEyhfNVul1tYqag== 2024-09-18T10:30:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDHq+pmJh+YABAAI8mUnQZjpERQQYNI3Zl8uQ== 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.11] 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDJq+pm/C4xOhAA3REviR3BnGK6W2cpc5JNuw== 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.15] 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDMq+pmXxoJOBAAzz39pAhx8l/QwwEq904VMw== 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-18T10:30:40.992 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCTq+pmuKogIhAA/QigjS1i9apgEpCMvHwz2g== 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCTq+pmKU/oGxAAng1tU+QoO16WTOMPaJrrZQ== 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCWq+pm3cQlMRAA9GruRtG3t0MP/FCCxmyOtg== 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCZq+pmvpKALxAA4+cKBBAKyg/o1A4Dw7fJJQ== 2024-09-18T10:30:40.994 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.8] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCcq+pmGXcpLRAAcciqHgIbRHR1KkXvQE48rQ== 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.12] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCfq+pm6esPLBAAZoIR31vHRcwE1RsQXmlUWw== 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQClq+pmXprqNBAAPX5pFT7sn4VL/UB1fLPy+g== 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCoq+pmrERtMhAApkD8XIYIfRCJkCojRRGwAQ== 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.9] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCrq+pm94hGMhAAdtOTI4qor6vqW86rxL6vRQ== 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.13] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCuq+pmPSXYLxAAftgTghg/EQyvMOgBCJpK4g== 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-09-18T10:30:40.995 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC0q+pmm/2XOBAAyXnRSvycTTfLlOIgb94UQw== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC3q+pmdUinNhAA9/gPh1Ud/WxCwpsck6Cq6w== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.10] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC6q+pmUO+FMxAAQ6Rj37C6lE8RCvZYXX71OQ== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.14] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9q+pmO8LfNBAAXr9rbGMGR8Eydx9p3dAgcQ== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCTq+pmNX20HxAAB6nG86wvZRDdFTxGA7hHew== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDEq+pmqxTKAhAApX1jhCqcEyhfNVul1tYqag== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDHq+pmJh+YABAAI8mUnQZjpERQQYNI3Zl8uQ== 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.11] 2024-09-18T10:30:40.996 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDJq+pm/C4xOhAA3REviR3BnGK6W2cpc5JNuw== 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.15] 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDMq+pmXxoJOBAAzz39pAhx8l/QwwEq904VMw== 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCTq+pmuKogIhAA/QigjS1i9apgEpCMvHwz2g== 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCTq+pmKU/oGxAAng1tU+QoO16WTOMPaJrrZQ== 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCWq+pm3cQlMRAA9GruRtG3t0MP/FCCxmyOtg== 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCZq+pmvpKALxAA4+cKBBAKyg/o1A4Dw7fJJQ== 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.8] 2024-09-18T10:30:40.997 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCcq+pmGXcpLRAAcciqHgIbRHR1KkXvQE48rQ== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.12] 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCfq+pm6esPLBAAZoIR31vHRcwE1RsQXmlUWw== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQClq+pmXprqNBAAPX5pFT7sn4VL/UB1fLPy+g== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCoq+pmrERtMhAApkD8XIYIfRCJkCojRRGwAQ== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.9] 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCrq+pm94hGMhAAdtOTI4qor6vqW86rxL6vRQ== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.13] 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCuq+pmPSXYLxAAftgTghg/EQyvMOgBCJpK4g== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC0q+pmm/2XOBAAyXnRSvycTTfLlOIgb94UQw== 2024-09-18T10:30:40.998 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC3q+pmdUinNhAA9/gPh1Ud/WxCwpsck6Cq6w== 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.10] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC6q+pmUO+FMxAAQ6Rj37C6lE8RCvZYXX71OQ== 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.14] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC9q+pmO8LfNBAAXr9rbGMGR8Eydx9p3dAgcQ== 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCTq+pmNX20HxAAB6nG86wvZRDdFTxGA7hHew== 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDEq+pmqxTKAhAApX1jhCqcEyhfNVul1tYqag== 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDHq+pmJh+YABAAI8mUnQZjpERQQYNI3Zl8uQ== 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.11] 2024-09-18T10:30:40.999 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDJq+pm/C4xOhAA3REviR3BnGK6W2cpc5JNuw== 2024-09-18T10:30:41.000 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.15] 2024-09-18T10:30:41.000 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDMq+pmXxoJOBAAzz39pAhx8l/QwwEq904VMw== 2024-09-18T10:30:41.000 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-18T10:30:41.000 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQCTq+pmuKogIhAA/QigjS1i9apgEpCMvHwz2g== 2024-09-18T10:30:41.000 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T10:30:41.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T10:30:41.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T10:30:41.090 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.348 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.449 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T10:30:41.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T10:30:41.708 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-18T10:30:41.754 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.855 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-18T10:30:41.957 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T10:30:41.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T10:30:41.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-18T10:30:42.010 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-18T10:30:42.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-18T10:30:42.035 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T10:30:42.128 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-18T10:30:42.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-18T10:30:42.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T10:30:42.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-18T10:30:42.295 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-18T10:30:42.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-18T10:30:42.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-18T10:30:42.436 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:42.438 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:42.441 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-18T10:30:42.491 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-18T10:30:42.491 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-18T10:30:42.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-18T10:30:42.495 INFO:tasks.ceph.mon.a:Started 2024-09-18T10:30:42.495 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-18T10:30:42.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-18T10:30:42.497 INFO:tasks.ceph.mon.b:Started 2024-09-18T10:30:42.498 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-18T10:30:42.498 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-18T10:30:42.533 INFO:tasks.ceph.mon.c:Started 2024-09-18T10:30:42.534 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-18T10:30:42.534 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-18T10:30:42.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-18T10:30:42.536 INFO:tasks.ceph.mgr.y:Started 2024-09-18T10:30:42.536 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-18T10:30:42.537 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-18T10:30:42.539 INFO:tasks.ceph.mgr.x:Started 2024-09-18T10:30:42.540 INFO:tasks.ceph:Setting crush tunables to default 2024-09-18T10:30:42.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-09-18T10:30:48.893 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-18T10:30:48.906 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-18T10:30:48.906 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:48.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-18T10:30:48.925 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:48.923+0000 7f4572443ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T10:30:48.933 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:48.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-18T10:30:48.934 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:48.930+0000 7f7aa8218ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-18T10:30:48.965 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:48.964+0000 7f4572443ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T10:30:48.974 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:48.972+0000 7f7aa8218ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-18T10:30:49.000 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:49.000 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-09-18T10:30:49.014 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:49.013+0000 7f4572443ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T10:30:49.027 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:49.024+0000 7f7aa8218ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-18T10:30:49.052 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-18T10:30:49.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2024-09-18T10:30:49.118 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:49.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-18T10:30:49.145 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:49.144+0000 7f4572443ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T10:30:49.148 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:49.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-18T10:30:49.180 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:49.177+0000 7f7aa8218ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-18T10:30:49.217 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:49.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-09-18T10:30:49.250 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:49.249+0000 7f4572443ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T10:30:49.285 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-18T10:30:49.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2024-09-18T10:30:49.291 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:49.289+0000 7f7aa8218ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-18T10:30:49.351 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:49.351 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-18T10:30:49.381 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:49.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-18T10:30:49.452 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:49.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-09-18T10:30:49.522 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-18T10:30:49.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2024-09-18T10:30:49.538 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:49.537+0000 7f4572443ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T10:30:49.587 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:49.588 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-18T10:30:49.593 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:49.592+0000 7f4572443ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T10:30:49.613 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:49.613 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-18T10:30:49.678 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:49.679 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-09-18T10:30:49.707 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:49.704+0000 7f7aa8218ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-18T10:30:49.730 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:49.729+0000 7f4572443ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T10:30:49.743 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-18T10:30:49.743 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2024-09-18T10:30:49.763 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:49.760+0000 7f7aa8218ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-18T10:30:49.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new c9c90e0f-90b7-4324-b194-50466925bab4 0 2024-09-18T10:30:49.900 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:49.898+0000 7f7aa8218ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-18T10:30:50.025 INFO:teuthology.orchestra.run.smithi160.stdout:0 2024-09-18T10:30:50.036 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 364707f8-7c53-4434-8eb4-bed8f4fd131d 1 2024-09-18T10:30:50.213 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-18T10:30:50.224 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new a1f8ec72-eb1a-4808-beba-7a6e6e840e5e 2 2024-09-18T10:30:50.430 INFO:teuthology.orchestra.run.smithi160.stdout:2 2024-09-18T10:30:50.445 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 7528ada4-39f9-44a0-b312-d9774c1c38b0 3 2024-09-18T10:30:50.618 INFO:teuthology.orchestra.run.smithi160.stdout:3 2024-09-18T10:30:50.629 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 7e30062e-3d74-4374-abe1-708614474f78 4 2024-09-18T10:30:50.730 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:50.728+0000 7f4572443ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T10:30:50.780 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:50.779+0000 7f4572443ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T10:30:50.801 INFO:teuthology.orchestra.run.smithi160.stdout:4 2024-09-18T10:30:50.812 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new cfbff4f8-6118-4080-8c53-a9191a6e2e2f 5 2024-09-18T10:30:50.873 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:50.871+0000 7f7aa8218ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-18T10:30:50.926 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:50.924+0000 7f7aa8218ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-18T10:30:50.987 INFO:teuthology.orchestra.run.smithi160.stdout:5 2024-09-18T10:30:50.998 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 2dc036cf-74e5-4e91-9f75-9f122e112a49 6 2024-09-18T10:30:51.164 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.162+0000 7f4572443ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-18T10:30:51.173 INFO:teuthology.orchestra.run.smithi160.stdout:6 2024-09-18T10:30:51.184 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 72893ca2-e288-4271-9fe0-c3df5c26d0c7 7 2024-09-18T10:30:51.250 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.249+0000 7f4572443ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T10:30:51.310 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.308+0000 7f7aa8218ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-18T10:30:51.343 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.342+0000 7f4572443ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T10:30:51.360 INFO:teuthology.orchestra.run.smithi160.stdout:7 2024-09-18T10:30:51.370 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new c5a0c4b5-4450-43bb-9571-509d1baa2db6 8 2024-09-18T10:30:51.390 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.389+0000 7f4572443ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T10:30:51.396 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.394+0000 7f7aa8218ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-18T10:30:51.488 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.486+0000 7f7aa8218ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-18T10:30:51.489 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.487+0000 7f4572443ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-18T10:30:51.537 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.532+0000 7f7aa8218ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-18T10:30:51.539 INFO:teuthology.orchestra.run.smithi160.stdout:8 2024-09-18T10:30:51.540 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.539+0000 7f4572443ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T10:30:51.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new bdca945d-8cfe-4bea-a7a6-10116f45f750 9 2024-09-18T10:30:51.585 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.584+0000 7f4572443ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T10:30:51.634 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.631+0000 7f7aa8218ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-18T10:30:51.684 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.682+0000 7f4572443ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T10:30:51.688 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.686+0000 7f7aa8218ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-18T10:30:51.733 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.731+0000 7f7aa8218ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-18T10:30:51.734 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.733+0000 7f4572443ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T10:30:51.758 INFO:teuthology.orchestra.run.smithi160.stdout:9 2024-09-18T10:30:51.769 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb 10 2024-09-18T10:30:51.787 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.786+0000 7f4572443ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T10:30:51.832 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.830+0000 7f7aa8218ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-18T10:30:51.857 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.856+0000 7f4572443ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T10:30:51.884 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.882+0000 7f7aa8218ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-18T10:30:51.902 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.901+0000 7f4572443ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T10:30:51.936 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:51.934+0000 7f7aa8218ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-18T10:30:51.939 INFO:teuthology.orchestra.run.smithi160.stdout:10 2024-09-18T10:30:51.944 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:51.943+0000 7f4572443ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T10:30:51.950 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 74271b10-6952-4938-9916-e89bc18a872f 11 2024-09-18T10:30:52.006 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:52.004+0000 7f7aa8218ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-18T10:30:52.051 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:52.048+0000 7f7aa8218ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-18T10:30:52.095 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:52.093+0000 7f7aa8218ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-18T10:30:52.161 INFO:teuthology.orchestra.run.smithi160.stdout:11 2024-09-18T10:30:52.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 9a3a5069-5cd1-450a-813b-ddd96237db5c 12 2024-09-18T10:30:52.362 INFO:teuthology.orchestra.run.smithi160.stdout:12 2024-09-18T10:30:52.373 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 47a76a68-b71d-4012-b2f7-3e40e8583a46 13 2024-09-18T10:30:52.545 INFO:teuthology.orchestra.run.smithi160.stdout:13 2024-09-18T10:30:52.557 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 5297107d-2ab9-4107-8461-0aa59c98d685 14 2024-09-18T10:30:52.602 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:52.601+0000 7f4572443ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T10:30:52.731 INFO:teuthology.orchestra.run.smithi160.stdout:14 2024-09-18T10:30:52.742 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 1bcc1d74-88c8-4dc5-8262-ead5b4a20377 15 2024-09-18T10:30:52.743 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-18T10:30:52.741+0000 7f7aa8218ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-18T10:30:52.910 INFO:teuthology.orchestra.run.smithi160.stdout:15 2024-09-18T10:30:52.921 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-18T10:30:52.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-18T10:30:52.923 INFO:tasks.ceph.osd.0:Started 2024-09-18T10:30:52.924 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-18T10:30:52.924 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-18T10:30:52.926 INFO:tasks.ceph.osd.4:Started 2024-09-18T10:30:52.926 INFO:tasks.ceph.osd.8:Restarting daemon 2024-09-18T10:30:52.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-09-18T10:30:52.928 INFO:tasks.ceph.osd.8:Started 2024-09-18T10:30:52.928 INFO:tasks.ceph.osd.12:Restarting daemon 2024-09-18T10:30:52.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-09-18T10:30:52.931 INFO:tasks.ceph.osd.12:Started 2024-09-18T10:30:52.931 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-18T10:30:52.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-18T10:30:52.934 INFO:tasks.ceph.osd.1:Started 2024-09-18T10:30:52.934 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-18T10:30:52.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-18T10:30:52.936 INFO:tasks.ceph.osd.5:Started 2024-09-18T10:30:52.936 INFO:tasks.ceph.osd.9:Restarting daemon 2024-09-18T10:30:52.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-09-18T10:30:52.939 INFO:tasks.ceph.osd.9:Started 2024-09-18T10:30:52.939 INFO:tasks.ceph.osd.13:Restarting daemon 2024-09-18T10:30:52.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2024-09-18T10:30:52.941 INFO:tasks.ceph.osd.13:Started 2024-09-18T10:30:52.941 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-18T10:30:52.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-18T10:30:52.944 INFO:tasks.ceph.osd.2:Started 2024-09-18T10:30:52.944 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-18T10:30:52.944 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-18T10:30:52.946 INFO:tasks.ceph.osd.6:Started 2024-09-18T10:30:52.947 INFO:tasks.ceph.osd.10:Restarting daemon 2024-09-18T10:30:52.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-09-18T10:30:52.949 INFO:tasks.ceph.osd.10:Started 2024-09-18T10:30:52.949 INFO:tasks.ceph.osd.14:Restarting daemon 2024-09-18T10:30:52.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-09-18T10:30:52.951 INFO:tasks.ceph.osd.14:Started 2024-09-18T10:30:52.951 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-18T10:30:52.952 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-18T10:30:52.953 INFO:tasks.ceph.osd.3:Started 2024-09-18T10:30:52.954 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-18T10:30:52.954 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-18T10:30:52.955 INFO:tasks.ceph.osd.7:Started 2024-09-18T10:30:52.956 INFO:tasks.ceph.osd.11:Restarting daemon 2024-09-18T10:30:52.956 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-09-18T10:30:52.957 INFO:tasks.ceph.osd.11:Started 2024-09-18T10:30:52.958 INFO:tasks.ceph.osd.15:Restarting daemon 2024-09-18T10:30:52.958 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2024-09-18T10:30:52.960 INFO:tasks.ceph.osd.15:Started 2024-09-18T10:30:52.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:30:53.137 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:30:53.137 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:30:52.907993+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T10:30:52.907993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:30:53.148 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-18T10:30:53.148 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-18T10:30:53.519 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:30:53.516+0000 7f7c10f21440 -1 Falling back to public interface 2024-09-18T10:30:53.522 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:30:53.520+0000 7fe437e0b440 -1 Falling back to public interface 2024-09-18T10:30:53.531 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:30:53.529+0000 7f0af1123440 -1 Falling back to public interface 2024-09-18T10:30:53.535 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:30:53.533+0000 7f8640d25440 -1 Falling back to public interface 2024-09-18T10:30:53.537 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:30:53.535+0000 7f070ed23440 -1 Falling back to public interface 2024-09-18T10:30:53.540 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:30:53.538+0000 7fab70b66440 -1 Falling back to public interface 2024-09-18T10:30:53.540 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:30:53.538+0000 7f947b846440 -1 Falling back to public interface 2024-09-18T10:30:53.544 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:30:53.542+0000 7f9c02b62440 -1 Falling back to public interface 2024-09-18T10:30:53.548 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:30:53.546+0000 7fae79a08440 -1 Falling back to public interface 2024-09-18T10:30:53.549 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:30:53.548+0000 7fcc27b84440 -1 Falling back to public interface 2024-09-18T10:30:53.551 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:30:53.550+0000 7f8b7c215440 -1 Falling back to public interface 2024-09-18T10:30:53.552 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:30:53.550+0000 7ff27aa30440 -1 Falling back to public interface 2024-09-18T10:30:53.553 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:30:53.552+0000 7f6e6c382440 -1 Falling back to public interface 2024-09-18T10:30:53.554 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:30:53.553+0000 7f2aa031f440 -1 Falling back to public interface 2024-09-18T10:30:53.554 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:30:53.553+0000 7f22ffe22440 -1 Falling back to public interface 2024-09-18T10:30:53.554 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:30:53.553+0000 7f2a9e5fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2024-09-18T10:30:53.555 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:30:53.554+0000 7f6e6a5fd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6815/0: (98) Address already in use 2024-09-18T10:30:53.555 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:30:53.554+0000 7f6e6a5fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2024-09-18T10:30:53.555 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:30:53.554+0000 7f1fd960b440 -1 Falling back to public interface 2024-09-18T10:30:53.619 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:53.614+0000 7f4556f14640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-18T10:30:53.619 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-18T10:30:53.614+0000 7f4556f14640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-18T10:30:54.755 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T10:30:55.034 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-18T10:30:55.034 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":18,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:30:52.907993+0000","last_up_change":"0.000000","last_in_change":"2024-09-18T10:30:52.907993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:30:55.045 DEBUG:teuthology.misc:0 of 16 OSDs are up 2024-09-18T10:30:56.955 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:30:56.953+0000 7f7c10f21440 -1 osd.0 0 log_to_monitors true 2024-09-18T10:30:56.989 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:30:56.988+0000 7f070ed23440 -1 osd.1 0 log_to_monitors true 2024-09-18T10:30:56.997 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:30:56.995+0000 7fe437e0b440 -1 osd.4 0 log_to_monitors true 2024-09-18T10:30:57.018 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:30:57.017+0000 7fcc27b84440 -1 osd.6 0 log_to_monitors true 2024-09-18T10:30:57.021 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:30:57.019+0000 7f8b7c215440 -1 osd.15 0 log_to_monitors true 2024-09-18T10:30:57.026 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:30:57.024+0000 7f0af1123440 -1 osd.8 0 log_to_monitors true 2024-09-18T10:30:57.034 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:30:57.031+0000 7f8640d25440 -1 osd.12 0 log_to_monitors true 2024-09-18T10:30:57.039 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:30:57.038+0000 7f947b846440 -1 osd.5 0 log_to_monitors true 2024-09-18T10:30:57.042 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:30:57.040+0000 7f1fd960b440 -1 osd.11 0 log_to_monitors true 2024-09-18T10:30:57.058 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:30:57.053+0000 7fab70b66440 -1 osd.9 0 log_to_monitors true 2024-09-18T10:30:57.059 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:30:57.055+0000 7f9c02b62440 -1 osd.13 0 log_to_monitors true 2024-09-18T10:30:57.066 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:30:57.065+0000 7fae79a08440 -1 osd.7 0 log_to_monitors true 2024-09-18T10:30:57.070 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:30:57.069+0000 7f2aa031f440 -1 osd.10 0 log_to_monitors true 2024-09-18T10:30:57.071 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:30:57.070+0000 7f6e6c382440 -1 osd.2 0 log_to_monitors true 2024-09-18T10:30:57.072 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:30:57.070+0000 7f22ffe22440 -1 osd.14 0 log_to_monitors true 2024-09-18T10:30:57.072 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:30:57.071+0000 7ff27aa30440 -1 osd.3 0 log_to_monitors true 2024-09-18T10:30:58.020 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:30:58.019+0000 7f07097f6640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T10:30:58.026 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:30:58.024+0000 7f7c0d1f9640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T10:30:58.027 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:30:58.025+0000 7fe4325f6640 -1 osd.4 0 waiting for initial osdmap 2024-09-18T10:30:58.028 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:30:58.027+0000 7f07067f0640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:58.032 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:30:58.030+0000 7f7c089f0640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:58.035 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:30:58.033+0000 7fe42f5f0640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.028 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:30:59.027+0000 7fab6b5f6640 -1 osd.9 0 waiting for initial osdmap 2024-09-18T10:30:59.029 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:30:59.028+0000 7fcc23df9640 -1 osd.6 0 waiting for initial osdmap 2024-09-18T10:30:59.029 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:30:59.027+0000 7f9bfd5f6640 -1 osd.13 0 waiting for initial osdmap 2024-09-18T10:30:59.032 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:30:59.031+0000 7ff275bf6640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T10:30:59.032 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:30:59.031+0000 7fae741f6640 -1 osd.7 0 waiting for initial osdmap 2024-09-18T10:30:59.032 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:30:59.031+0000 7f8b769f6640 -1 osd.15 0 waiting for initial osdmap 2024-09-18T10:30:59.033 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:30:59.031+0000 7f6e66df6640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T10:30:59.033 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:30:59.030+0000 7f0aebbf6640 -1 osd.8 0 waiting for initial osdmap 2024-09-18T10:30:59.033 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:30:59.031+0000 7f2a9adf6640 -1 osd.10 0 waiting for initial osdmap 2024-09-18T10:30:59.034 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:30:59.031+0000 7f22fa5f6640 -1 osd.14 0 waiting for initial osdmap 2024-09-18T10:30:59.035 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:30:59.033+0000 7f863b7f6640 -1 osd.12 0 waiting for initial osdmap 2024-09-18T10:30:59.036 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:30:59.034+0000 7f9475ff6640 -1 osd.5 0 waiting for initial osdmap 2024-09-18T10:30:59.037 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:30:59.036+0000 7f9bfa5f0640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.038 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:30:59.037+0000 7f1fd3df6640 -1 osd.11 0 waiting for initial osdmap 2024-09-18T10:30:59.038 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:30:59.037+0000 7fab685f0640 -1 osd.9 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.040 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:30:59.038+0000 7f0ae8bf0640 -1 osd.8 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.040 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:30:59.039+0000 7f6e63df0640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.041 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:30:59.038+0000 7f863868c640 -1 osd.12 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.041 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:30:59.040+0000 7f8b739f0640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.042 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:30:59.040+0000 7ff272a8c640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.042 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:30:59.040+0000 7fae711f0640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.042 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:30:59.041+0000 7f2a97df0640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.043 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:30:59.040+0000 7f9472ff0640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.043 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:30:59.041+0000 7fcc1f5f0640 -1 osd.6 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.043 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:30:59.041+0000 7f22f75f0640 -1 osd.14 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:30:59.046 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:30:59.045+0000 7f1fd0c8c640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:31:02.661 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-18T10:31:02.948 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-18T10:31:02.948 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":24,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:31:02.050211+0000","last_up_change":"2024-09-18T10:31:00.027262+0000","last_in_change":"2024-09-18T10:30:52.907993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":32743},{"type":"v1","addr":"172.21.15.71:6810","nonce":32743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":32743},{"type":"v1","addr":"172.21.15.71:6814","nonce":32743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":32743},{"type":"v1","addr":"172.21.15.71:6822","nonce":32743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":32743},{"type":"v1","addr":"172.21.15.71:6818","nonce":32743}]},"public_addr":"172.21.15.71:6810/32743","cluster_addr":"172.21.15.71:6814/32743","heartbeat_back_addr":"172.21.15.71:6822/32743","heartbeat_front_addr":"172.21.15.71:6818/32743","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.990432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.941659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.111884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.061397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.963684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.033416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.049603+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.068434+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.011033+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.090509+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.057952+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.040059+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.024718+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.029645+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.093324+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.008295+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:31:02.959 DEBUG:teuthology.misc:16 of 16 OSDs are up 2024-09-18T10:31:02.959 INFO:tasks.ceph:Creating RBD pool 2024-09-18T10:31:02.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-18T10:31:04.167 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'rbd' created 2024-09-18T10:31:04.180 DEBUG:teuthology.orchestra.run.smithi063:> rbd --cluster ceph pool init rbd 2024-09-18T10:31:07.201 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-18T10:31:07.201 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T10:31:07.201 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-18T10:31:07.202 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-18T10:31:07.202 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-18T10:31:07.536 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:07.546 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":32147},{"type":"v1","addr":"172.21.15.160:6801","nonce":32147}]},"active_addr":"172.21.15.160:6801/32147","active_change":"2024-09-18T10:30:52.604380+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1514431517}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":297495683}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1002531955}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1826052363}]}]} 2024-09-18T10:31:07.552 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-18T10:31:07.552 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T10:31:07.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:31:07.829 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:07.829 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:31:07.176400+0000","last_up_change":"2024-09-18T10:31:00.027262+0000","last_in_change":"2024-09-18T10:30:52.907993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":32743},{"type":"v1","addr":"172.21.15.71:6810","nonce":32743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":32743},{"type":"v1","addr":"172.21.15.71:6814","nonce":32743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":32743},{"type":"v1","addr":"172.21.15.71:6822","nonce":32743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":32743},{"type":"v1","addr":"172.21.15.71:6818","nonce":32743}]},"public_addr":"172.21.15.71:6810/32743","cluster_addr":"172.21.15.71:6814/32743","heartbeat_back_addr":"172.21.15.71:6822/32743","heartbeat_front_addr":"172.21.15.71:6818/32743","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.990432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.941659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.111884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.061397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.963684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.033416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.049603+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.068434+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.011033+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.090509+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.057952+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.040059+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.024718+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.029645+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.093324+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.008295+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:31:07.842 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T10:31:07.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:31:08.116 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:08.116 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:31:07.176400+0000","last_up_change":"2024-09-18T10:31:00.027262+0000","last_in_change":"2024-09-18T10:30:52.907993+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":32743},{"type":"v1","addr":"172.21.15.71:6810","nonce":32743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":32743},{"type":"v1","addr":"172.21.15.71:6814","nonce":32743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":32743},{"type":"v1","addr":"172.21.15.71:6822","nonce":32743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":32743},{"type":"v1","addr":"172.21.15.71:6818","nonce":32743}]},"public_addr":"172.21.15.71:6810/32743","cluster_addr":"172.21.15.71:6814/32743","heartbeat_back_addr":"172.21.15.71:6822/32743","heartbeat_front_addr":"172.21.15.71:6818/32743","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.990432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.941659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.111884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.061397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.963684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.033416+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.049603+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.068434+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.011033+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.090509+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.057952+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.040059+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.024718+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.029645+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.093324+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.008295+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:31:08.132 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T10:31:08.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T10:31:08.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T10:31:08.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T10:31:08.134 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T10:31:08.134 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T10:31:08.135 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T10:31:08.135 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T10:31:08.135 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-18T10:31:08.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-18T10:31:08.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-18T10:31:08.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-18T10:31:08.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-18T10:31:08.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-18T10:31:08.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-18T10:31:08.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-18T10:31:08.533 INFO:teuthology.orchestra.run.smithi063.stdout:94489280517 2024-09-18T10:31:08.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-18T10:31:08.549 INFO:teuthology.orchestra.run.smithi063.stdout:90194313221 2024-09-18T10:31:08.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T10:31:08.558 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:08.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-18T10:31:08.573 INFO:teuthology.orchestra.run.smithi063.stdout:90194313220 2024-09-18T10:31:08.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T10:31:08.579 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T10:31:08.589 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:08.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T10:31:08.597 INFO:teuthology.orchestra.run.smithi063.stdout:90194313221 2024-09-18T10:31:08.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T10:31:08.614 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-18T10:31:08.615 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:08.616 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-18T10:31:08.633 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T10:31:08.637 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.637 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-18T10:31:08.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-18T10:31:08.662 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:08.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T10:31:08.683 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.684 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:08.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-18T10:31:08.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-18T10:31:08.730 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:08.730 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T10:31:09.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:09.098+0000 7f9f937fe640 0 --2- 172.21.15.63:0/2574892985 >> v2:172.21.15.63:3300/0 conn(0x7f9f8c0516a0 0x7f9f8c0e27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-18T10:31:09.494 INFO:teuthology.orchestra.run.smithi063.stdout:94489280517 2024-09-18T10:31:09.523 INFO:teuthology.orchestra.run.smithi063.stdout:90194313221 2024-09-18T10:31:09.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.8 2024-09-18T10:31:09.531 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.542 INFO:teuthology.orchestra.run.smithi063.stdout:90194313220 2024-09-18T10:31:09.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.4 2024-09-18T10:31:09.548 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.0 2024-09-18T10:31:09.576 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.584 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:09.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.2 2024-09-18T10:31:09.608 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.647 INFO:teuthology.orchestra.run.smithi063.stdout:90194313221 2024-09-18T10:31:09.676 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:09.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.1 2024-09-18T10:31:09.684 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.727 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:09.727 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:09.732 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:09.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.12 2024-09-18T10:31:09.732 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.740 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:09.750 INFO:teuthology.orchestra.run.smithi063.stdout:94489280514 2024-09-18T10:31:09.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.10 2024-09-18T10:31:09.759 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.9 2024-09-18T10:31:09.766 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.14 2024-09-18T10:31:09.769 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.771 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:09.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280514 for osd.5 2024-09-18T10:31:09.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.6 2024-09-18T10:31:09.774 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.774 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:09.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.11 2024-09-18T10:31:09.787 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:09.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.13 2024-09-18T10:31:09.801 INFO:teuthology.orchestra.run.smithi063.stdout:94489280514 2024-09-18T10:31:09.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280514 for osd.15 2024-09-18T10:31:09.819 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:09.820 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:09.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.3 2024-09-18T10:31:09.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.7 2024-09-18T10:31:09.835 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:10.773 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T10:31:10.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-18T10:31:10.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-18T10:31:10.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T10:31:11.147 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:11.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.13 2024-09-18T10:31:11.167 INFO:teuthology.orchestra.run.smithi063.stdout:94489280514 2024-09-18T10:31:11.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280514 for osd.5 2024-09-18T10:31:11.181 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:11.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.3 2024-09-18T10:31:11.235 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:11.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.15 2024-09-18T10:31:11.248 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:12.161 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-18T10:31:12.180 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T10:31:12.195 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T10:31:12.458 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:12.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.13 2024-09-18T10:31:12.472 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:12.548 INFO:teuthology.orchestra.run.smithi063.stdout:94489280515 2024-09-18T10:31:12.550 INFO:teuthology.orchestra.run.smithi063.stdout:94489280516 2024-09-18T10:31:12.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.5 2024-09-18T10:31:12.562 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:12.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.3 2024-09-18T10:31:12.563 DEBUG:teuthology.parallel:result is None 2024-09-18T10:31:12.564 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T10:31:12.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:12.881 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:12.882 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:12.893 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-18T10:31:12.612403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4762376,"kb_used_data":4592,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505187064,"statfs":{"total":1546188226560,"available":1541311553536,"internally_reserved":0,"allocated":4702208,"data_stored":3119702,"data_compressed":341818,"data_compressed_allocated":524288,"data_compressed_original":1941504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.435463"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190304+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:07.190304+0000","last_peered":"2024-09-18T10:31:07.190304+0000","last_clean":"2024-09-18T10:31:07.190304+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:07.190304+0000","last_undegraded":"2024-09-18T10:31:07.190304+0000","last_fullsized":"2024-09-18T10:31:07.190304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643575+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:07.643575+0000","last_peered":"2024-09-18T10:31:07.643575+0000","last_clean":"2024-09-18T10:31:07.643575+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:07.643575+0000","last_undegraded":"2024-09-18T10:31:07.643575+0000","last_fullsized":"2024-09-18T10:31:07.643575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426331+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:07.426331+0000","last_peered":"2024-09-18T10:31:07.426331+0000","last_clean":"2024-09-18T10:31:07.426331+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:07.426331+0000","last_undegraded":"2024-09-18T10:31:07.426331+0000","last_fullsized":"2024-09-18T10:31:07.426331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.183537+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:07.183537+0000","last_peered":"2024-09-18T10:31:07.183537+0000","last_clean":"2024-09-18T10:31:07.183537+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:07.183537+0000","last_undegraded":"2024-09-18T10:31:07.183537+0000","last_fullsized":"2024-09-18T10:31:07.183537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190910+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:07.190910+0000","last_peered":"2024-09-18T10:31:07.190910+0000","last_clean":"2024-09-18T10:31:07.190910+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:07.190910+0000","last_undegraded":"2024-09-18T10:31:07.190910+0000","last_fullsized":"2024-09-18T10:31:07.190910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426576+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:07.426576+0000","last_peered":"2024-09-18T10:31:07.426576+0000","last_clean":"2024-09-18T10:31:07.426576+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:07.426576+0000","last_undegraded":"2024-09-18T10:31:07.426576+0000","last_fullsized":"2024-09-18T10:31:07.426576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643392+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:07.643392+0000","last_peered":"2024-09-18T10:31:07.643392+0000","last_clean":"2024-09-18T10:31:07.643392+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:07.643392+0000","last_undegraded":"2024-09-18T10:31:07.643392+0000","last_fullsized":"2024-09-18T10:31:07.643392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426629+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:07.426629+0000","last_peered":"2024-09-18T10:31:07.426629+0000","last_clean":"2024-09-18T10:31:07.426629+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:07.426629+0000","last_undegraded":"2024-09-18T10:31:07.426629+0000","last_fullsized":"2024-09-18T10:31:07.426629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-18T10:31:06.393025+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:06.393025+0000","last_peered":"2024-09-18T10:31:06.393025+0000","last_clean":"2024-09-18T10:31:06.393025+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:06.393025+0000","last_undegraded":"2024-09-18T10:31:06.393025+0000","last_fullsized":"2024-09-18T10:31:06.393025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,5,6,7,8,9,10,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":8,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:12.896 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:13.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:13.172 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:13.184 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-18T10:31:12.612403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4762376,"kb_used_data":4592,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505187064,"statfs":{"total":1546188226560,"available":1541311553536,"internally_reserved":0,"allocated":4702208,"data_stored":3119702,"data_compressed":341818,"data_compressed_allocated":524288,"data_compressed_original":1941504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.435463"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190304+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:07.190304+0000","last_peered":"2024-09-18T10:31:07.190304+0000","last_clean":"2024-09-18T10:31:07.190304+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:07.190304+0000","last_undegraded":"2024-09-18T10:31:07.190304+0000","last_fullsized":"2024-09-18T10:31:07.190304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643575+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:07.643575+0000","last_peered":"2024-09-18T10:31:07.643575+0000","last_clean":"2024-09-18T10:31:07.643575+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:07.643575+0000","last_undegraded":"2024-09-18T10:31:07.643575+0000","last_fullsized":"2024-09-18T10:31:07.643575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426331+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:07.426331+0000","last_peered":"2024-09-18T10:31:07.426331+0000","last_clean":"2024-09-18T10:31:07.426331+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:07.426331+0000","last_undegraded":"2024-09-18T10:31:07.426331+0000","last_fullsized":"2024-09-18T10:31:07.426331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.183537+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:07.183537+0000","last_peered":"2024-09-18T10:31:07.183537+0000","last_clean":"2024-09-18T10:31:07.183537+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:07.183537+0000","last_undegraded":"2024-09-18T10:31:07.183537+0000","last_fullsized":"2024-09-18T10:31:07.183537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190910+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:07.190910+0000","last_peered":"2024-09-18T10:31:07.190910+0000","last_clean":"2024-09-18T10:31:07.190910+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:07.190910+0000","last_undegraded":"2024-09-18T10:31:07.190910+0000","last_fullsized":"2024-09-18T10:31:07.190910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426576+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:07.426576+0000","last_peered":"2024-09-18T10:31:07.426576+0000","last_clean":"2024-09-18T10:31:07.426576+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:07.426576+0000","last_undegraded":"2024-09-18T10:31:07.426576+0000","last_fullsized":"2024-09-18T10:31:07.426576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643392+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:07.643392+0000","last_peered":"2024-09-18T10:31:07.643392+0000","last_clean":"2024-09-18T10:31:07.643392+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:07.643392+0000","last_undegraded":"2024-09-18T10:31:07.643392+0000","last_fullsized":"2024-09-18T10:31:07.643392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426629+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:07.426629+0000","last_peered":"2024-09-18T10:31:07.426629+0000","last_clean":"2024-09-18T10:31:07.426629+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:07.426629+0000","last_undegraded":"2024-09-18T10:31:07.426629+0000","last_fullsized":"2024-09-18T10:31:07.426629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-18T10:31:06.393025+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:06.393025+0000","last_peered":"2024-09-18T10:31:06.393025+0000","last_clean":"2024-09-18T10:31:06.393025+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:06.393025+0000","last_undegraded":"2024-09-18T10:31:06.393025+0000","last_fullsized":"2024-09-18T10:31:06.393025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,5,6,7,8,9,10,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":8,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:13.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T10:31:13.186 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T10:31:13.186 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-18T10:31:13.187 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-18T10:31:13.491 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:13.491 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T10:31:13.503 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-18T10:31:13.503 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-18T10:31:13.513 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-18T10:31:13.513 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}} 2024-09-18T10:31:13.513 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-18T10:31:13.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-18T10:31:13.808 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-18T10:31:13.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T10:31:13.809 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:14.080 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:14.092 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-18T10:31:12.612403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4762376,"kb_used_data":4592,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505187064,"statfs":{"total":1546188226560,"available":1541311553536,"internally_reserved":0,"allocated":4702208,"data_stored":3119702,"data_compressed":341818,"data_compressed_allocated":524288,"data_compressed_original":1941504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.435463"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190304+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:07.190304+0000","last_peered":"2024-09-18T10:31:07.190304+0000","last_clean":"2024-09-18T10:31:07.190304+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:07.190304+0000","last_undegraded":"2024-09-18T10:31:07.190304+0000","last_fullsized":"2024-09-18T10:31:07.190304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643575+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:07.643575+0000","last_peered":"2024-09-18T10:31:07.643575+0000","last_clean":"2024-09-18T10:31:07.643575+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:07.643575+0000","last_undegraded":"2024-09-18T10:31:07.643575+0000","last_fullsized":"2024-09-18T10:31:07.643575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426331+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:07.426331+0000","last_peered":"2024-09-18T10:31:07.426331+0000","last_clean":"2024-09-18T10:31:07.426331+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:07.426331+0000","last_undegraded":"2024-09-18T10:31:07.426331+0000","last_fullsized":"2024-09-18T10:31:07.426331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.183537+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:07.183537+0000","last_peered":"2024-09-18T10:31:07.183537+0000","last_clean":"2024-09-18T10:31:07.183537+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:07.183537+0000","last_undegraded":"2024-09-18T10:31:07.183537+0000","last_fullsized":"2024-09-18T10:31:07.183537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190910+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:07.190910+0000","last_peered":"2024-09-18T10:31:07.190910+0000","last_clean":"2024-09-18T10:31:07.190910+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:07.190910+0000","last_undegraded":"2024-09-18T10:31:07.190910+0000","last_fullsized":"2024-09-18T10:31:07.190910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426576+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:07.426576+0000","last_peered":"2024-09-18T10:31:07.426576+0000","last_clean":"2024-09-18T10:31:07.426576+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:07.426576+0000","last_undegraded":"2024-09-18T10:31:07.426576+0000","last_fullsized":"2024-09-18T10:31:07.426576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643392+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:07.643392+0000","last_peered":"2024-09-18T10:31:07.643392+0000","last_clean":"2024-09-18T10:31:07.643392+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:07.643392+0000","last_undegraded":"2024-09-18T10:31:07.643392+0000","last_fullsized":"2024-09-18T10:31:07.643392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426629+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:07.426629+0000","last_peered":"2024-09-18T10:31:07.426629+0000","last_clean":"2024-09-18T10:31:07.426629+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:07.426629+0000","last_undegraded":"2024-09-18T10:31:07.426629+0000","last_fullsized":"2024-09-18T10:31:07.426629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-18T10:31:06.393025+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:06.393025+0000","last_peered":"2024-09-18T10:31:06.393025+0000","last_clean":"2024-09-18T10:31:06.393025+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:06.393025+0000","last_undegraded":"2024-09-18T10:31:06.393025+0000","last_fullsized":"2024-09-18T10:31:06.393025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,5,6,7,8,9,10,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":8,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:14.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:14.366 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:14.378 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-18T10:31:12.612403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4762376,"kb_used_data":4592,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505187064,"statfs":{"total":1546188226560,"available":1541311553536,"internally_reserved":0,"allocated":4702208,"data_stored":3119702,"data_compressed":341818,"data_compressed_allocated":524288,"data_compressed_original":1941504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.435463"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190304+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:07.190304+0000","last_peered":"2024-09-18T10:31:07.190304+0000","last_clean":"2024-09-18T10:31:07.190304+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:07.190304+0000","last_undegraded":"2024-09-18T10:31:07.190304+0000","last_fullsized":"2024-09-18T10:31:07.190304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643575+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:07.643575+0000","last_peered":"2024-09-18T10:31:07.643575+0000","last_clean":"2024-09-18T10:31:07.643575+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:07.643575+0000","last_undegraded":"2024-09-18T10:31:07.643575+0000","last_fullsized":"2024-09-18T10:31:07.643575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426331+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:07.426331+0000","last_peered":"2024-09-18T10:31:07.426331+0000","last_clean":"2024-09-18T10:31:07.426331+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:07.426331+0000","last_undegraded":"2024-09-18T10:31:07.426331+0000","last_fullsized":"2024-09-18T10:31:07.426331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.183537+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:07.183537+0000","last_peered":"2024-09-18T10:31:07.183537+0000","last_clean":"2024-09-18T10:31:07.183537+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:07.183537+0000","last_undegraded":"2024-09-18T10:31:07.183537+0000","last_fullsized":"2024-09-18T10:31:07.183537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.190910+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:07.190910+0000","last_peered":"2024-09-18T10:31:07.190910+0000","last_clean":"2024-09-18T10:31:07.190910+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:07.190910+0000","last_undegraded":"2024-09-18T10:31:07.190910+0000","last_fullsized":"2024-09-18T10:31:07.190910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426576+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:07.426576+0000","last_peered":"2024-09-18T10:31:07.426576+0000","last_clean":"2024-09-18T10:31:07.426576+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:07.426576+0000","last_undegraded":"2024-09-18T10:31:07.426576+0000","last_fullsized":"2024-09-18T10:31:07.426576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.643392+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:07.643392+0000","last_peered":"2024-09-18T10:31:07.643392+0000","last_clean":"2024-09-18T10:31:07.643392+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:07.643392+0000","last_undegraded":"2024-09-18T10:31:07.643392+0000","last_fullsized":"2024-09-18T10:31:07.643392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426629+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:07.426629+0000","last_peered":"2024-09-18T10:31:07.426629+0000","last_clean":"2024-09-18T10:31:07.426629+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:07.426629+0000","last_undegraded":"2024-09-18T10:31:07.426629+0000","last_fullsized":"2024-09-18T10:31:07.426629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-18T10:31:06.393025+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:06.393025+0000","last_peered":"2024-09-18T10:31:06.393025+0000","last_clean":"2024-09-18T10:31:06.393025+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:06.393025+0000","last_undegraded":"2024-09-18T10:31:06.393025+0000","last_fullsized":"2024-09-18T10:31:06.393025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7,8,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":1,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,5,6,7,8,9,10,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297704,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074136,"statfs":{"total":96636764160,"available":96331915264,"internally_reserved":0,"allocated":339968,"data_stored":657791,"data_compressed":30048,"data_compressed_allocated":61440,"data_compressed_original":569344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":8,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":10,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":286720,"data_stored":128863,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":12,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":290816,"data_stored":128882,"data_compressed":20123,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:14.380 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T10:31:14.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-18T10:31:14.652 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 30 2024-09-18T10:31:14.652 INFO:teuthology.orchestra.run.smithi063.stdout:fsid f10241a9-9f2d-4ca9-8e5f-6c8b84917f59 2024-09-18T10:31:14.652 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-18T10:30:48.790325+0000 2024-09-18T10:31:14.652 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-18T10:31:12.576932+0000 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:crush_version 5 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:full_ratio 0.95 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:backfillfull_ratio 0.9 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:nearfull_ratio 0.85 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:require_min_compat_client luminous 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:min_compat_client jewel 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:require_osd_release quincy 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:stretch_mode_enabled false 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 29 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd 2024-09-18T10:31:14.653 INFO:teuthology.orchestra.run.smithi063.stdout:max_osd 16 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/33484,v1:172.21.15.63:6801/33484] [v2:172.21.15.63:6802/33484,v1:172.21.15.63:6803/33484] exists,up c9c90e0f-90b7-4324-b194-50466925bab4 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/32741,v1:172.21.15.71:6801/32741] [v2:172.21.15.71:6802/32741,v1:172.21.15.71:6803/32741] exists,up 364707f8-7c53-4434-8eb4-bed8f4fd131d 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/33036,v1:172.21.15.100:6810/33036] [v2:172.21.15.100:6813/33036,v1:172.21.15.100:6816/33036] exists,up a1f8ec72-eb1a-4808-beba-7a6e6e840e5e 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6811/33050,v1:172.21.15.160:6813/33050] [v2:172.21.15.160:6814/33050,v1:172.21.15.160:6816/33050] exists,up 7528ada4-39f9-44a0-b312-d9774c1c38b0 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 up in weight 1 up_from 21 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6808/33485,v1:172.21.15.63:6809/33485] [v2:172.21.15.63:6810/33485,v1:172.21.15.63:6811/33485] exists,up 7e30062e-3d74-4374-abe1-708614474f78 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6809/32742,v1:172.21.15.71:6811/32742] [v2:172.21.15.71:6813/32742,v1:172.21.15.71:6815/32742] exists,up cfbff4f8-6118-4080-8c53-a9191a6e2e2f 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 up in weight 1 up_from 22 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/33037,v1:172.21.15.100:6801/33037] [v2:172.21.15.100:6802/33037,v1:172.21.15.100:6803/33037] exists,up 2dc036cf-74e5-4e91-9f75-9f122e112a49 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6802/33051,v1:172.21.15.160:6803/33051] [v2:172.21.15.160:6804/33051,v1:172.21.15.160:6805/33051] exists,up 72893ca2-e288-4271-9fe0-c3df5c26d0c7 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/33488,v1:172.21.15.63:6817/33488] [v2:172.21.15.63:6818/33488,v1:172.21.15.63:6819/33488] exists,up c5a0c4b5-4450-43bb-9571-509d1baa2db6 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/32743,v1:172.21.15.71:6810/32743] [v2:172.21.15.71:6812/32743,v1:172.21.15.71:6814/32743] exists,up bdca945d-8cfe-4bea-a7a6-10116f45f750 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6811/33038,v1:172.21.15.100:6814/33038] [v2:172.21.15.100:6817/33038,v1:172.21.15.100:6820/33038] exists,up 2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6826/33052,v1:172.21.15.160:6827/33052] [v2:172.21.15.160:6828/33052,v1:172.21.15.160:6829/33052] exists,up 74271b10-6952-4938-9916-e89bc18a872f 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6824/33486,v1:172.21.15.63:6825/33486] [v2:172.21.15.63:6826/33486,v1:172.21.15.63:6827/33486] exists,up 9a3a5069-5cd1-450a-813b-ddd96237db5c 2024-09-18T10:31:14.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/32744,v1:172.21.15.71:6825/32744] [v2:172.21.15.71:6826/32744,v1:172.21.15.71:6827/32744] exists,up 47a76a68-b71d-4012-b2f7-3e40e8583a46 2024-09-18T10:31:14.655 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] [v2:172.21.15.100:6815/33039,v1:172.21.15.100:6818/33039] exists,up 5297107d-2ab9-4107-8461-0aa59c98d685 2024-09-18T10:31:14.655 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] [v2:172.21.15.160:6815/33053,v1:172.21.15.160:6817/33053] exists,up 1bcc1d74-88c8-4dc5-8262-ead5b4a20377 2024-09-18T10:31:14.664 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/33484,v1:172.21.15.63:6801/33484] [v2:172.21.15.63:6802/33484,v1:172.21.15.63:6803/33484] exists,up c9c90e0f-90b7-4324-b194-50466925bab4', 'osd.1 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/32741,v1:172.21.15.71:6801/32741] [v2:172.21.15.71:6802/32741,v1:172.21.15.71:6803/32741] exists,up 364707f8-7c53-4434-8eb4-bed8f4fd131d', 'osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/33036,v1:172.21.15.100:6810/33036] [v2:172.21.15.100:6813/33036,v1:172.21.15.100:6816/33036] exists,up a1f8ec72-eb1a-4808-beba-7a6e6e840e5e', 'osd.3 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6811/33050,v1:172.21.15.160:6813/33050] [v2:172.21.15.160:6814/33050,v1:172.21.15.160:6816/33050] exists,up 7528ada4-39f9-44a0-b312-d9774c1c38b0', 'osd.4 up in weight 1 up_from 21 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6808/33485,v1:172.21.15.63:6809/33485] [v2:172.21.15.63:6810/33485,v1:172.21.15.63:6811/33485] exists,up 7e30062e-3d74-4374-abe1-708614474f78', 'osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6809/32742,v1:172.21.15.71:6811/32742] [v2:172.21.15.71:6813/32742,v1:172.21.15.71:6815/32742] exists,up cfbff4f8-6118-4080-8c53-a9191a6e2e2f', 'osd.6 up in weight 1 up_from 22 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/33037,v1:172.21.15.100:6801/33037] [v2:172.21.15.100:6802/33037,v1:172.21.15.100:6803/33037] exists,up 2dc036cf-74e5-4e91-9f75-9f122e112a49', 'osd.7 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6802/33051,v1:172.21.15.160:6803/33051] [v2:172.21.15.160:6804/33051,v1:172.21.15.160:6805/33051] exists,up 72893ca2-e288-4271-9fe0-c3df5c26d0c7', 'osd.8 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/33488,v1:172.21.15.63:6817/33488] [v2:172.21.15.63:6818/33488,v1:172.21.15.63:6819/33488] exists,up c5a0c4b5-4450-43bb-9571-509d1baa2db6', 'osd.9 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/32743,v1:172.21.15.71:6810/32743] [v2:172.21.15.71:6812/32743,v1:172.21.15.71:6814/32743] exists,up bdca945d-8cfe-4bea-a7a6-10116f45f750', 'osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6811/33038,v1:172.21.15.100:6814/33038] [v2:172.21.15.100:6817/33038,v1:172.21.15.100:6820/33038] exists,up 2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb', 'osd.11 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6826/33052,v1:172.21.15.160:6827/33052] [v2:172.21.15.160:6828/33052,v1:172.21.15.160:6829/33052] exists,up 74271b10-6952-4938-9916-e89bc18a872f', 'osd.12 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6824/33486,v1:172.21.15.63:6825/33486] [v2:172.21.15.63:6826/33486,v1:172.21.15.63:6827/33486] exists,up 9a3a5069-5cd1-450a-813b-ddd96237db5c', 'osd.13 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/32744,v1:172.21.15.71:6825/32744] [v2:172.21.15.71:6826/32744,v1:172.21.15.71:6827/32744] exists,up 47a76a68-b71d-4012-b2f7-3e40e8583a46', 'osd.14 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] [v2:172.21.15.100:6815/33039,v1:172.21.15.100:6818/33039] exists,up 5297107d-2ab9-4107-8461-0aa59c98d685', 'osd.15 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] [v2:172.21.15.160:6815/33053,v1:172.21.15.160:6817/33053] exists,up 1bcc1d74-88c8-4dc5-8262-ead5b4a20377'] 2024-09-18T10:31:14.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mon.a", 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster": "ceph", 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "admin_socket_mode": "", 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-18T10:31:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_client_required": "cephx, none", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_cluster_required": "cephx", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_debug": "true", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_service_required": "cephx", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_supported": "cephx", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio": "true", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_poll_ms": "250", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_reap_max": "16", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_async_discard": "false", 2024-09-18T10:31:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_block_size": "4096", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_inflight_ios": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_enable_discard": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_flock_retry": "3", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_inject_crash": "0", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring_hipri": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-18T10:31:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_type": "", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_alloc_size": "1048576", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_allocator": "hybrid", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_buffered_io": "true", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_for_zeros": "false", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_compact_log_sync": "false", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-18T10:31:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_max_log_runway": "4194304", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_max_prefetch": "1048576", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_min_flush_size": "524288", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_min_log_runway": "1048576", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_replay_recovery": "false", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_sync_write": "false", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_allocation_from_file": "true", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_allocator": "hybrid", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_async_db_compaction": "true", 2024-09-18T10:31:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_create": "true", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_create": "false", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_path": "", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_size": "0", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_path": "", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_preallocate_file": "false", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_size": "107374182400", 2024-09-18T10:31:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_create": "false", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_path": "", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_size": "100663296", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs": "true", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_autotune": "true", 2024-09-18T10:31:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size": "0", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_type": "2q", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_clone_cow": "true", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-18T10:31:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_mode": "none", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_csum_type": "crc32c", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_freelist": "false", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_bug21040": "false", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-18T10:31:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_prefill": "0.000000", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-18T10:31:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_small_allocations": "0", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_default_buffered_read": "true", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_default_buffered_write": "false", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-18T10:31:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fail_eio": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mount": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_umount": "false", 2024-09-18T10:31:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_ignore_data_csum": "false", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_op_age": "5.000000", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_alloc_size": "0", 2024-09-18T10:31:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size": "0", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_deferred_txc": "32", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size": "0", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_nid_prealloc": "1024", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-18T10:31:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_retry_disk_reads": "3", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_cf": "true", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_mem": "512", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-18T10:31:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_tracing": "false", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_zero_block_detection": "false", 2024-09-18T10:31:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-18T10:31:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_cluster_require_signatures": "false", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_cluster_require_version": "2", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_require_signatures": "false", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_require_version": "2", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_service_require_signatures": "false", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_service_require_version": "2", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_sign_messages": "true", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "chdir": "", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_acl_type": "", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_asio_thread_count": "2", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_cache_mid": "0.750000", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_cache_size": "16384", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps_release_delay": "5", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_check_pool_perm": "true", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-18T10:31:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_force_sync_read": "false", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_getattr_caps": "false", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_inject_features": "", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_inject_tick_delay": "0", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_die_on_failed_remount": "false", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_dirsize_rbytes": "true", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_force_lazyio": "false", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_fs": "", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_inject_release_failure": "false", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_max_inline_size": "4096", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-18T10:31:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mds_namespace": "", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": "", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_gid": "-1", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_timeout": "300", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_uid": "-1", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mountpoint": "/", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_notify_timeout": "10", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc": "true", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_dirty": "104857600", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_objects": "1000", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_size": "209715200", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_target_dirty": "8388608", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_permissions": "true", 2024-09-18T10:31:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "client_quota": "true", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_quota_df": "true", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_max_bytes": "0", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_max_periods": "4", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_min": "131072", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_reconnect_stale": "false", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_shutdown_timeout": "30", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_snapdir": ".snap", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_tick_interval": "1", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_trace": "", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_try_dentry_invalidate": "false", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_use_faked_inos": "false", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "client_use_random_mds": "false", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog": "false", 2024-09-18T10:31:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog_port": "12201", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_monitors": "default=true", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog": "false", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog_level": "info", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "-", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_network": "", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_network_interface": "", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_isal": "false", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_level": "5", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_winsize": "-15", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zstd_level": "1", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-18T10:31:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_alien_op_num_threads": "6", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_obc_lru_size": "10", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location": "", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location_hook": "", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location_hook_timeout": "10", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "daemonize": "false", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_alienstore": "0/5", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_allow_any_pool_priority": "false", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asok": "1/5", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asok_assert_abort": "false", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asserts_on_shutdown": "true", 2024-09-18T10:31:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_auth": "20/20", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bdev": "1/3", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bluefs": "1/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bluestore": "1/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_buffer": "0/1", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_ceph_exporter": "1/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cephfs_mirror": "0/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cephsqlite": "0/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_civetweb": "1/10", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_client": "0/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_compressor": "1/5", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_context": "0/1", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crush": "1/1", 2024-09-18T10:31:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crypto": "1/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_deliberately_leak_memory": "false", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_disable_randomized_ping": "false", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_dpdk": "1/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_eventtrace": "1/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_filer": "0/1", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_filestore": "1/3", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_finisher": "1/1", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_fuse": "1/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_heartbeat_testing_span": "0", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_heartbeatmap": "1/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_javaclient": "1/5", 2024-09-18T10:31:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_journal": "1/3", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_journaler": "0/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_kstore": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_leveldb": "4/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_lockdep": "0/1", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mclock": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_balancer": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_locker": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_log": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_log_expire": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_migrator": "1/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_memdb": "4/5", 2024-09-18T10:31:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mgr": "2/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mgrc": "1/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mon": "20/20", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_monc": "0/10", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_ms": "1/1", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_none": "0/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objclass": "0/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objectcacher": "0/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objecter": "0/1", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_optracker": "0/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_osd": "1/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_paxos": "20/20", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_perfcounter": "1/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_prioritycache": "1/5", 2024-09-18T10:31:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rados": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_mirror": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_pwl": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_replay": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_refs": "0/0", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_reserver": "1/1", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw": "1/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_datacache": "1/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_sync": "1/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rocksdb": "4/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_cache": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_cleaner": "0/5", 2024-09-18T10:31:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_device": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_journal": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_lba": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_odata": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_omap": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_onode": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_tm": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_striper": "0/1", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_test": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_throttle": "1/1", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_timer": "0/1", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_tp": "0/5", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "device_failure_prediction_mode": "none", 2024-09-18T10:31:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_graylog": "false", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_journald": "false", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_stderr": "true", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_syslog": "false", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event_tracing": "false", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_addr": "0.0.0.0", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_http_port": "9926", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_prio_limit": "5", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_sort_metrics": "true", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_stats_period": "5", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "fake_statfs_for_testing": "0", 2024-09-18T10:31:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "fatal_signal_handlers": "true", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filer_max_purge_ops": "10", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filer_max_truncate_ops": "128", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_apply_finisher_threads": "1", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_blackhole": "false", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_btrfs_clone_range": "true", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_btrfs_snap": "true", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_caller_concurrency": "10", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_collect_device_partition_information": "true", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_commit_timeout": "600.000000", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_inject_read_err": "false", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_omap_check": "false", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-18T10:31:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_verify_split": "false", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_dump_file": "", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fadvise": "true", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fail_eio": "true", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fd_cache_shards": "16", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fd_cache_size": "128", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fiemap": "false", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fiemap_threshold": "4096", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_inject_stall": "0", 2024-09-18T10:31:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_parallel": "false", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_trailing": "false", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_writeahead": "false", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_kill_at": "0", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs": "0", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-18T10:31:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size": "0", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_merge_threshold": "-10", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_odsync_write": "false", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_backend": "rocksdb", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_backend_path": "", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_thread_timeout": "60", 2024-09-18T10:31:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_threads": "2", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_punch_hole": "false", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_ops": "50", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_seek_data_hole": "false", 2024-09-18T10:31:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_sloppy_crc": "false", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_splice": "false", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_split_multiple": "2", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_split_rand_factor": "20", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_update_to": "1000", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-18T10:31:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_enable": "true", 2024-09-18T10:31:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_xfs_extsize": "false", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_zfs_snap": "false", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "fio_dir": "/tmp/fio", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "f10241a9-9f2d-4ca9-8e5f-6c8b84917f59", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_allow_other": "true", 2024-09-18T10:31:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_atomic_o_trunc": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_big_writes": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_debug": "false", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_default_permissions": "false", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_disable_pagecache": "false", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_max_write": "0", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_multithreaded": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_require_active_mds": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_set_user_groups": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_move": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_read": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_write": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-18T10:31:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_use_invalidate_cb": "true", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "gss_target_name": "ceph", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_file": "", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_inject_failure": "0", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_interval": "5", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "host": "smithi063", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-18T10:31:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "inject_early_sigterm": "false", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "jaeger_tracing_enable": "false", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_aio": "true", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_align_min_size": "65536", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_block_align": "true", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_block_size": "4096", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_dio": "true", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_discard": "false", 2024-09-18T10:31:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_force_aio": "false", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_ignore_corruption": "false", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_max_write_bytes": "10485760", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_max_write_entries": "100", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_replay_from": "0", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_write_header_frequency": "0", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_zero_on_create": "false", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_prefetch_periods": "10", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_prezero_periods": "5", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_write_head_interval": "15", 2024-09-18T10:31:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "keyfile": "", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_backend": "rocksdb", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_default_stripe_size": "65536", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_fsck_on_mount": "false", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_max_bytes": "67108864", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_max_ops": "512", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_nid_prealloc": "1024", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_onode_map_size": "1024", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_sync_submit_transaction": "false", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_sync_transaction": "false", 2024-09-18T10:31:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_block_size": "65536", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_bloom_size": "0", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_cache_size": "536870912", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_compact_on_mount": "false", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_compression": "false", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_log": "", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_log_to_ceph_log": "true", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_max_open_files": "0", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_paranoid": "false", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "leveldb_write_buffer_size": "33554432", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "librados_thread_count": "2", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "lockdep": "false", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "lockdep_force_backtrace": "false", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "log_coarse_timestamps": "true", 2024-09-18T10:31:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_flush_on_exit": "false", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_graylog_host": "127.0.0.1", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_graylog_port": "12201", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_max_new": "1000", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_max_recent": "10000", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_stderr_prefix": "", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_stop_at_utilization": "0.970000", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": "true", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_graylog": "false", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_journald": "false", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_stderr": "false", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_syslog": "false", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "max_rotating_auth_attempts": "10", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-18T10:31:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_action_on_write_error": "1", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_alternate_name_max": "8192", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_asio_thread_count": "2", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_export_pin": "true", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_dirs": "true", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_interval": "5", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_interval": "10", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_max": "-1", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_max_until": "-1", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_merge_size": "50", 2024-09-18T10:31:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_midchunk": "0.300000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_min_start": "0.200000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_minchunk": "0.001000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_mode": "0", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_need_max": "1.200000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_need_min": "0.800000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_bits": "3", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_size": "10000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_target_decay": "10.000000", 2024-09-18T10:31:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_grace": "15.000000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_interval": "4.000000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_mid": "0.700000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_release_free_interval": "10", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_reservation": "0.050000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_interval": "1", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_threshold": "262144", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-18T10:31:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_prealloc_inos": "1000", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_connect_bootstrapping": "false", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_damage_table_max_entries": "10000", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_auth_pins": "false", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_frag": "false", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_scatterstat": "false", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_subtrees": "false", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_decay_halflife": "5.000000", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_default_dir_hash": "2", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_defer_session_stale": "true", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_deny_all_reconnect": "false", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_keys_per_op": "16384", 2024-09-18T10:31:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_max_commit_size": "10", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_max_entries": "0", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_on_map": "false", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_early_reply": "true", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_enable_op_tracker": "true", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_enforce_unique_name": "true", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_random": "true", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-18T10:31:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_health_summarize_threshold": "10", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_health_dummy": "false", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_migrator_session_race": "false", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-18T10:31:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_join_fs": "", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_journal_format": "1", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_create_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_export_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_import_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_expire_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_replay_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_link_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_mdstable_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_openc_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_rename_at": "0", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-09-18T10:31:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_events_per_segment": "1024", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_max_events": "-1", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_max_segments": "128", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_pause": "false", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_segment_size": "0", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_warn_factor": "2.000000", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_caps_per_client": "1048576", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_completed_flushes": "100000", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_completed_requests": "100000", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_export_size": "20971520", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_file_recover": "32", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_files": "64", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops": "8192", 2024-09-18T10:31:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_snaps_per_dir": "100", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_xattr_pairs_size": "65536", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_metrics_update_interval": "2", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_min_caps_per_client": "100", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_min_caps_working_set": "10000", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_numa_node": "-1", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_complaint_time": "30.000000", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_duration": "600", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_size": "20", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_slow_op_size": "20", 2024-09-18T10:31:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_log_threshold": "5", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_ping_grace": "15", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_ping_interval": "5", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_caps": "30000", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_warning_threshold": "262144", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_replay_interval": "1.000000", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-18T10:31:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_root_ino_gid": "0", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_root_ino_uid": "0", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_shutdown_check": "0", 2024-09-18T10:31:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_skip_ino": "0", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_max_uid": "4294967294", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_min_uid": "0", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_rstat": "false", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_standby_replay_damaged": "false", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_symlink_recovery": "true", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_thrash_exports": "0", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_thrash_fragments": "0", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_tick_interval": "5.000000", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_valgrind_exit": "false", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_verify_backtrace": "1", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_verify_scatter": "false", 2024-09-18T10:31:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_wipe_sessions": "false", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool_debug": "false", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_device_bytes": "1073741824", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_page_set": "false", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_page_size": "65536", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_bytes": "134217728", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_messages": "512", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_disabled_modules": "diskprediction_local", 2024-09-18T10:31:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_max_pg_num_change": "128", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mds_bytes": "134217728", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mds_messages": "128", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mon_bytes": "134217728", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mon_messages": "128", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_osd_bytes": "536870912", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_osd_messages": "8192", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_pool": "true", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_standby_modules": "true", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_stats_period": "5", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_stats_threshold": "5", 2024-09-18T10:31:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_tick_period": "2", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_allow_pool_delete": "true", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_allow_pool_size_one": "true", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_auth_validate_all_caps": "true", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_bytes": "104857600", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_directed_command_retry": "5", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-18T10:31:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_parallel": "3", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_log_interval": "1.000000", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_ping_interval": "10.000000", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_level": "debug", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_file": "true", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_journald": "false", 2024-09-18T10:31:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_bootstrap": "false", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_start": "false", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_trim": "true", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cpu_threads": "4", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_crush_min_required_version": "hammer", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_daemon_bytes": "419430400", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_avail_crit": "5", 2024-09-18T10:31:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_avail_warn": "5", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_size_warn": "16106127360", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_json": "false", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_transactions": "false", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_extra_checks": "false", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-18T10:31:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_pacific": "false", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_quincy": "false", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_down_mkfs_grace": "120", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_election_default_strategy": "3", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_election_timeout": "5.000000", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ping_divisor": "2", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_enable_op_tracker": "true", 2024-09-18T10:31:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_fake_pool_delete": "false", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_force_quorum_join": "false", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_globalid_prealloc": "10000", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_detail_to_clog": "false", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_log_update_period": "5", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_max_detail": "50", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog": "true", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog_interval": "600", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_host": "172.21.15.63,172.21.15.71,172.21.15.100", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_host_override": "", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_initial_members": "", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-18T10:31:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease": "5.000000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_full_interval": "50", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_max": "10000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_max_summary": "50", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_log_epochs": "500", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_osd": "10000", 2024-09-18T10:31:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_pg_per_osd": "10000", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_pool_pg_num": "65536", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_force_trim_to": "0", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_skip_sanity": "false", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_memory_autotune": "true", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_memory_target": "2147483648", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_beacon_grace": "30", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_digest_period": "5", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_inactive_grace": "60", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-18T10:31:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_min_osdmap_epochs": "500", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_complaint_time": "30", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_duration": "600", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_size": "20", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_slow_op_size": "20", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_log_threshold": "5", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_in": "false", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-18T10:31:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_cache_size": "500", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_down_out_interval": "600", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_force_trim_to": "0", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-18T10:31:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_down_reporters": "2", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_report_timeout": "900", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-18T10:31:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_stuck_threshold": "60", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_probe_timeout": "2.000000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_max_change": "0.050000", 2024-09-18T10:31:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_max_osds": "4", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_interval": "300", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_max_keys": "100", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_timeout": "300", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_session_timeout": "300", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_smart_report_timeout": "5", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stat_smooth_intervals": "6", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_pool_min_size": "2", 2024-09-18T10:31:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_pool_size": "4", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_debug": "false", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_provider_kill_at": "0", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_requester_kill_at": "0", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_timeout": "60.000000", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_target_pg_per_osd": "100", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_tick_interval": "5", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_timecheck_interval": "300.000000", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-18T10:31:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_older_version_delay": "604800", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_misplaced": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_older_version": "true", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-18T10:31:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "monmap": "", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_op_threads": "3", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_cm": "false", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_device_name": "", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_dscp": "96", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-18T10:31:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_local_gid": "", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_port_num": "1", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_sl": "3", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_support_srq": "true", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_type": "ib", 2024-09-18T10:31:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_reap_threshold": "5", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_before_connect": "false", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_ipv4": "true", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_ipv6": "false", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_msgr1": "true", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_msgr2": "true", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_port_max": "7568", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_port_min": "6800", 2024-09-18T10:31:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_retry_count": "3", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_retry_delay": "5", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_client": "false", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mds": "false", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mgr": "false", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mon": "false", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_osd": "false", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_client_mode": "crc secure", 2024-09-18T10:31:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_cluster_mode": "crc secure", 2024-09-18T10:31:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_cluster_type": "", 2024-09-18T10:31:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_compress_secure": "false", 2024-09-18T10:31:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_connection_idle_timeout": "900", 2024-09-18T10:31:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_connection_ready_timeout": "10", 2024-09-18T10:31:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_crc_data": "true", 2024-09-18T10:31:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_crc_header": "true", 2024-09-18T10:31:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_bad_msg": "false", 2024-09-18T10:31:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_bug": "true", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_old_message": "true", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_skipped_message": "false", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_coremask": "0xF", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-18T10:31:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_enable_tso": "true", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hugepages": "", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_lro": "true", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_memory_channel": "4", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_pmd": "", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_port_id": "0", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-18T10:31:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dump_on_send": "false", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_initial_backoff": "0.200000", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_max": "1.000000", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_type": "", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_socket_failures": "2500", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_learn_addr_from_peer": "true", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_max_accept_failures": "4", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_max_backoff": "15.000000", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_client_mode": "secure crc", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_service_mode": "secure crc", 2024-09-18T10:31:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compress_min_size": "1024", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compress_mode": "none", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compression_algorithm": "snappy zlib zstd lz4", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_pq_min_cost": "65536", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_public_type": "", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_service_mode": "crc secure", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_listen_backlog": "512", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_nodelay": "true", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_rcvbuf": "0", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_type": "async+posix", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "no_config_file": "false", 2024-09-18T10:31:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_completion_locks_per_session": "32", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inflight_ops": "1024", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_tick_interval": "5.000000", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_timeout": "10.000000", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "objectstore_blackhole": "false", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "openssl_engine_opts": "", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_delay_time": "5.000000", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_hist_halflife": "1000", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_max_low_ops": "2", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_max_ops": "4", 2024-09-18T10:31:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_slop": "0.020000", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_asio_thread_count": "2", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_async_recovery_min_cost": "100", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_scan_max": "512", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_scan_min": "64", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_degraded": "false", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_peering": "false", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_unfound": "true", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_beacon_report_interval": "300", 2024-09-18T10:31:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_duration": "30", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_max_block_size": "67108864", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_blkin_trace_all": "false", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_check_for_log_corruption": "false", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_update_on_start": "true", 2024-09-18T10:31:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_message_cap": "256", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_message_size_cap": "524288000", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_op_priority": "63", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_watch_timeout": "30", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_command_max_records": "256", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_compact_on_start": "false", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_update_on_start": "true", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_update_weight_set": "true", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-18T10:31:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-18T10:31:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-18T10:31:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_feed_pullee": "-1", 2024-09-18T10:31:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-18T10:31:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-18T10:31:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_misdirected_ops": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_no_acting_change": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_no_purge_strays": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_op_order": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_shutdown": "false", 2024-09-18T10:31:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_snaps": "false", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_keys": "1024", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_stride": "524288", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-18T10:31:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_default_notify_timeout": "30", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep": "0.000000", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_discard_disconnected_ops": "true", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_enable_op_tracker": "true", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_info": "true", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown": "true", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-18T10:31:14.853 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_function_tracing": "false", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_grace": "20", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_interval": "6", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_peers": "10", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_size": "2000", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_stale": "600", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_max_size": "100000", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_min_size": "1000", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-18T10:31:14.854 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal_size": "5120", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_kill_backfill_at": "0", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_cache_size": "50", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_dedup": "true", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_message_max": "40", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_share_max_epochs": "40", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_attr_name_len": "100", 2024-09-18T10:31:14.855 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_attr_size": "0", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_backfills": "1", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_markdown_count": "5", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_markdown_period": "600", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_name_len": "2048", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_namespace_len": "256", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_size": "134217728", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_blocked_by": "16", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_log_entries": "10000", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pgls": "1024", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_push_cost": "8388608", 2024-09-18T10:31:14.856 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_push_objects": "10", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_scrubs": "3", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_trimming_pgs": "2", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_write_op_reply_len": "64", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_write_size": "90", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-18T10:31:14.857 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_profile": "balanced", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_base": "805306368", 2024-09-18T10:31:14.858 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_cache_min": "134217728", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target": "4294967296", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target_autotune": "false", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_min_pg_log_entries": "250", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_min_recovery_priority": "0", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_report_interval": "5", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_num_cache_shards": "32", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_num_op_tracker_shard": "32", 2024-09-18T10:31:14.859 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_auto_affinity": "true", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_node": "-1", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_prefer_iface": "true", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objecter_finishers": "1", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore": "bluestore", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore_fuse": "false", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore_tracing": "false", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_complaint_time": "30.000000", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_duration": "600", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_size": "20", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_slow_op_size": "20", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-18T10:31:14.860 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_log_threshold": "5", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards": "0", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards_hdd": "5", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards_ssd": "8", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_pq_min_cost": "65536", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_queue_cut_off": "high", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_thread_timeout": "15", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_open_classes_on_start": "true", 2024-09-18T10:31:14.861 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_os_flags": "0", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_peering_op_priority": "255", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_delete_cost": "1048576", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_delete_priority": "5", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_trim_max": "10000", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_trim_min": "100", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_stat_report_interval_max": "500", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-18T10:31:14.862 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flags": "0", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_min_size": "0", 2024-09-18T10:31:14.863 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pg_num": "32", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pgp_num": "0", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_size": "2", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_type": "replicated", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_push_per_object_cost": "1000", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recover_clone_overlap": "true", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_cost": "20971520", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-18T10:31:14.864 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active": "10", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_single_start": "10", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_op_priority": "3", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_priority": "5", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep": "0.000000", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-18T10:31:14.865 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_repair_during_recovery": "false", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_requested_scrub_priority": "120", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_auto_repair": "false", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_begin_hour": "0", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_begin_week_day": "0", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_chunk_max": "25", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_chunk_min": "5", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_cost": "52428800", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_during_recovery": "false", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_end_hour": "0", 2024-09-18T10:31:14.866 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_end_week_day": "0", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_event_cost": "4096", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_invalid_stats": "true", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_max_preemptions": "5", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_priority": "5", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_sleep": "0.000000", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_skip_data_digest": "false", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_smart_report_timeout": "5", 2024-09-18T10:31:14.867 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_cost": "1048576", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_priority": "5", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_target_transaction_size": "30", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-18T10:31:14.868 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tracing": "false", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_use_stale_snap": "false", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "osdc_blkin_trace_all": "false", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_kill_at": "0", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_max_join_drift": "10", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_min": "500", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_min_wait": "0.050000", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_propose_interval": "1.000000", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_max": "500", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-18T10:31:14.869 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_min": "250", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_stash_full_interval": "25", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_trim_max": "500", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_trim_min": "250", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "perf": "true", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "-", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrv": "", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "public_bind_addr": "-", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "public_network": "", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "public_network_interface": "", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_enabled": "false", 2024-09-18T10:31:14.870 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_mon_op_timeout": "0", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_osd_op_timeout": "0", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_tracing": "false", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_atime_update_interval": "60", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_balance_parent_reads": "false", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_balance_snap_reads": "false", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blkin_trace_all": "false", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache": "true", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-18T10:31:14.871 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_policy": "writearound", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_size": "33554432", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_clone_copy_on_read": "false", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_compression_hint": "none", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_concurrent_management_ops": "10", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_clone_format": "auto", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_data_pool": "", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_features": "61", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_format": "2", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_map_options": "", 2024-09-18T10:31:14.872 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_order": "22", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_pool": "rbd", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_stripe_count": "0", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_stripe_unit": "0", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_enable_alloc_hint": "true", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_io_scheduler": "simple", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-18T10:31:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_order": "24", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_pool": "", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_splay_width": "4", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_localize_parent_reads": "false", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_localize_snap_reads": "false", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-18T10:31:14.874 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-18T10:31:14.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-18T10:31:14.876 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mtime_update_interval": "60", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_non_blocking_aio": "true", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_op_thread_timeout": "60", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_op_threads": "1", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_parent_cache_enabled": "false", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_plugins": "", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_burst": "0", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_limit": "0", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_exclude_ops": "0", 2024-09-18T10:31:14.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_burst": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_limit": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-18T10:31:14.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_read_from_replica_policy": "default", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_skip_partial_discard": "true", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_tracing": "false", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_validate_names": "true", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_validate_pool": "true", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "restapi_base_url": "", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "restapi_log_level": "", 2024-09-18T10:31:14.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_acl_grants_max_num": "100", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_admin_entry": "admin", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_backend_store": "rados", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_barbican_url": "", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_beast_enable_async": "true", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_enabled": "true", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_expiry_interval": "900", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_lru_size": "10000", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_content_length_compat": "false", 2024-09-18T10:31:14.880 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_copy_obj_progress": "true", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cors_rules_max_num": "100", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cross_domain_policy": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_addr": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_password": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_username": "", 2024-09-18T10:31:14.881 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_require_ssl": "true", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-18T10:31:14.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_addr": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_auth": "token", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_namespace": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_prefix": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_token_file": "", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_buffersize": "524288", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_low_speed_time": "300", 2024-09-18T10:31:14.883 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_changes_size": "1000", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_num_shards": "128", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-18T10:31:14.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_window": "30", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_notify_interval_msec": "200", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-18T10:31:14.885 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-18T10:31:14.886 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dns_name": "", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dns_s3website_name": "", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dynamic_resharding": "true", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_gc_threads": "true", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_lc_threads": "true", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_ops_log": "false", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_quota_threads": "true", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_static_website": "false", 2024-09-18T10:31:14.887 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_usage_log": "false", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enforce_swift_acls": "true", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_exit_timeout_secs": "120", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_expose_bucket": "false", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_extended_http_attrs": "", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_frontends": "beast port=7480", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_deferred": "50", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_objs": "32", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-18T10:31:14.888 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_processor_period": "3600", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_init_timeout": "300", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_connection_idle": "300", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_domain": "", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_password": "", 2024-09-18T10:31:14.889 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_password_path": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_project": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_tenant": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_token": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_token_path": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_user": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_api_version": "2", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_domain": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_password": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_project": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_user": "", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-18T10:31:14.890 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_url": "", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_debug_interval": "-1", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_lock_max_time": "90", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_objs": "32", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_rules": "1000", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_worker": "3", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_thread_delay": "0", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_dnattr": "uid", 2024-09-18T10:31:14.891 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_searchfilter": "", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_uri": "", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_http_headers": "", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_object_name_utc": "false", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attr_name_len": "0", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attr_size": "0", 2024-09-18T10:31:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_chunk_size": "4194304", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_listing_results": "1000", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_notify_retries": "10", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_put_param_size": "1048576", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_put_size": "5368709120", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_slo_entries": "1000", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_md_log_max_shards": "64", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_mp_lock_max_time": "600", 2024-09-18T10:31:14.893 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_max_gc": "300", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-18T10:31:14.894 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_num_async_rados_threads": "32", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_num_control_oids": "8", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_numa_node": "-1", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_chunk_size": "100", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_gc_interval": "600", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_thread_timeout": "600", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_tracing": "false", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_token": "", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_url": "", 2024-09-18T10:31:14.895 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_verify_ssl": "true", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_file_path": "", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_rados": "true", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_socket_path": "", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_push_interval": "2.000000", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_print_continue": "true", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-18T10:31:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_tracing": "false", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm": "", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm_id": "", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_region": "", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_request_uri": "", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_batch_size": "64", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-18T10:31:14.897 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_max_aio": "128", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_num_logs": "16", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_thread_interval": "600", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_resolve_cname": "false", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_run_sync_thread": "true", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-18T10:31:14.898 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_scheduler_type": "throttler", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_script_uri": "", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_service_provider_name": "", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_client_id": "", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_client_secret": "", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_entry": "sts", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_key": "sts", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_min_session_duration": "900", 2024-09-18T10:31:14.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_token_introspection_url": "", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_account_in_url": "false", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_auth_entry": "auth", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_auth_url": "", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_custom_header": "", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_need_stats": "true", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_tenant_name": "", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_token_expiration": "86400", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_url": "", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_url_prefix": "swift", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-18T10:31:14.900 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_lease_period": "120", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_thread_pool_size": "512", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_comment": "", 2024-09-18T10:31:14.901 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_createby": "", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_encoding": "", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_flag": "false", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_origin": "", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_tracker": "", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_trust_forwarded_https": "false", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_max_shards": "32", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_max_user_shards": "1", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_use_opa_authz": "false", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-18T10:31:14.902 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_max_buckets": "1000", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_unique_email": "true", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_verify_ssl": "true", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone": "", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone_id": "", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup": "", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup_id": "", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_block_size": "4096", 2024-09-18T10:31:14.903 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_size": "536870912", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-18T10:31:14.904 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_index_type": "binary_search", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_partition_filters": "false", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_perf": "false", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "run_dir": "/var/run/ceph", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_block_create": "true", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_cache_lru_size": "67108864", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_default_max_object_size": "16777216", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-18T10:31:14.905 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_device_size": "107374182400", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_init_rewrite_segments_num_per_device": "6", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_capacity": "16", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_segment_size": "67108864", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "setgroup": "", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "setuser": "", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "setuser_match_path": "", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "thp": "false", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "threadpool_default_timeout": "60", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-18T10:31:14.906 INFO:teuthology.orchestra.run.smithi063.stdout: "throttler_perf_counter": "true" 2024-09-18T10:31:14.907 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:14.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-18T10:31:15.021 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a: {} 2024-09-18T10:31:15.022 INFO:teuthology.orchestra.run.smithi063.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T10:31:15.031 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b: {} 2024-09-18T10:31:15.031 INFO:teuthology.orchestra.run.smithi063.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T10:31:15.040 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c: {} 2024-09-18T10:31:15.040 INFO:teuthology.orchestra.run.smithi063.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T10:31:15.051 DEBUG:teuthology.orchestra.run.smithi160:> type ceph-objectstore-tool 2024-09-18T10:31:15.070 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T10:31:15.070 DEBUG:teuthology.orchestra.run.smithi100:> type ceph-objectstore-tool 2024-09-18T10:31:15.088 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T10:31:15.089 DEBUG:teuthology.orchestra.run.smithi063:> type ceph-objectstore-tool 2024-09-18T10:31:15.104 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T10:31:15.104 DEBUG:teuthology.orchestra.run.smithi071:> type ceph-objectstore-tool 2024-09-18T10:31:15.122 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T10:31:15.123 INFO:teuthology.run_tasks:Running task rados... 2024-09-18T10:31:15.134 INFO:tasks.rados:Beginning rados... 2024-09-18T10:31:15.134 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False} 2024-09-18T10:31:15.134 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath11-testing-2024-09-18-1115-quincy', 'sha1': '7061ea6ca50908d104e9f3979dc615e118d9e153'}} 2024-09-18T10:31:15.134 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False} 2024-09-18T10:31:15.135 DEBUG:teuthology.run_tasks:Unwinding manager rados 2024-09-18T10:31:15.187 INFO:tasks.rados:joining rados 2024-09-18T10:31:15.187 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-18T10:31:15.187 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:15.187 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:31:15.188 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-18T10:31:15.188 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-18T10:31:15.188 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:15.188 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-18T10:31:15.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:15.189 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-18T10:31:15.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:31:15.190 INFO:tasks.rados:clients are ['client.0'] 2024-09-18T10:31:15.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set shecprofile c=2 crush-failure-domain=osd k=4 m=3 name=shecprofile plugin=shec 2024-09-18T10:31:15.191 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:15.188+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:15.290 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:15.288+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:15.307 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:15.307 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:15.307 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:15.307 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:15.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:15.326 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:15.326 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:15.345 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:15.346 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:15.377 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:15.377 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:15.391 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:15.389+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:15.394 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:15.410 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:15.411 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:15.427 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:15.433 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:15.442 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:15.443 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:15.444 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:15.460 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:15.461 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:15.478 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:15.492 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:15.490+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:15.494 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:15.510 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:15.511 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:15.527 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:15.527 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:15.557 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:15.557 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:15.560 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:15.560 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:15.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:15.580 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:15.580 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:15.593 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:15.591+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:15.596 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:15.596 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:15.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:15.596+0000 7f0a23fff640 0 -- 172.21.15.63:0/276030409 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7f0a24197dd0 msgr2=0x7f0a2419a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:15.681 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:15.681 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:15.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:15.693 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:15.692+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:15.794 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:15.793+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:15.814 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:15.814 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:15.833 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:15.833 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:15.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:15.895 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:15.894+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:15.985 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:15.985 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:15.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:15.995 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:15.994+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:16.096 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:16.095+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:16.096 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.097 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.105 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:16.197 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:16.196+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:16.206 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.206 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:16.223 INFO:teuthology.orchestra.run.smithi063.stderr:load: shec 2024-09-18T10:31:16.226 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:31:16.238 INFO:tasks.rados:starting run 0 out of 1 2024-09-18T10:31:16.238 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-18T10:31:16.239 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure shecprofile 2024-09-18T10:31:16.297 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:16.296+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:16.328 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.328 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:16.399 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:16.396+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:16.440 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.440 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:16.499 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:16.498+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:16.551 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.551 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.561 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:16.602 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:16.601+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:16.701 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:16.700+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:16.703 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.704 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:16.801 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:16.800+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:16.902 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:16.901+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:16.929 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:16.929 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:16.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:17.003 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:17.002+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:17.036 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.037 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:17.104 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:17.103+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:17.144 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.144 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:17.205 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:17.203+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:17.251 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.251 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:17.343 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:17.342+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:17.397 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.397 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:17.407 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:17.406+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:17.507 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:17.506+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.544 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:17.608 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:17.607+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.691 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:17.709 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:17.708+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:17.797 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.797 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:17.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:17.849 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:17.848+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:17.902 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:17.902 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:17.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:17.912 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:17.909+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:17.957 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:17.958 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:17.975 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:17.975 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:17.991 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:17.992 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:18.008 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:18.008 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:18.011 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:18.010+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:18.023 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:18.023 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:18.039 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:18.039 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:18.049 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:18.050 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:18.055 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:18.055 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:18.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:18.071 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:18.087 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:18.087 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:18.102 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:18.102 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:18.114 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:18.113+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:18.118 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:18.118 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:18.135 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:18.135 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:18.150 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:18.150 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:18.157 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:18.157 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:18.165 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:18.166 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:18.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:18.181 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:18.182 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:18.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:18.182+0000 7fa15abc8640 0 -- 172.21.15.63:0/2140479785 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7fa154195b60 msgr2=0x7fa154197f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:18.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:18.197 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:18.215 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:18.214+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:18.239 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'unique_pool_0' created 2024-09-18T10:31:18.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T10:31:18.259 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-18T10:31:18.283 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:18.283 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:18.283 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:18.284 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:18.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:18.343 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:18.342+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:18.391 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:18.391 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:18.391 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:18.391 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:18.392 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:18.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:18.417 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:18.415+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:18.497 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:18.497 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:18.497 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:18.497 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [] 2024-09-18T10:31:18.497 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:18.505 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:18.517 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:18.516+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:18.603 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:18.604 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:18.604 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:18.604 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:18.612 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:18.618 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:18.617+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:18.709 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:18.709 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:18.709 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:18.709 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:18.709 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:18.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:18.719 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:18.717+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:18.817 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:18.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 16.754103548, 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76442072000000005, 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.818 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060653+0000", 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060661+0000", 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4030000000000007e-06 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060672+0000", 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:31:18.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060691+0000", 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8553e-05 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060740+0000", 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060747+0000", 2024-09-18T10:31:18.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1399999999999997e-06 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.823811+0000", 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76306395100000002 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824007+0000", 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000196737 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824158+0000", 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000150913 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824701+0000", 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054279800000000004 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825007+0000", 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030596600000000002 2024-09-18T10:31:18.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825044+0000", 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6853000000000001e-05 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825075+0000", 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1102000000000001e-05 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.819311662, 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089361909999999996, 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 47 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995550+0000", 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000104314 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995559+0000", 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7069999999999998e-06 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995568+0000", 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1479999999999995e-06 2024-09-18T10:31:18.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999298+0000", 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037306729999999999 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999379+0000", 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0304999999999998e-05 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999486+0000", 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010773299999999999 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001630+0000", 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021436200000000002 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004321+0000", 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0026907049999999998 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004355+0000", 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4591000000000001e-05 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004382+0000", 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6869999999999999e-05 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:18.830 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.819181507, 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089031370000000002, 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 48 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:18.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995580+0000", 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.532e-06 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995586+0000", 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8989999999999998e-06 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995590+0000", 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9099999999999998e-06 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999825+0000", 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042355350000000003 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999877+0000", 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1273999999999997e-05 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999957+0000", 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0098000000000005e-05 2024-09-18T10:31:18.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001636+0000", 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016796300000000001 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004425+0000", 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0027888000000000001 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004456+0000", 2024-09-18T10:31:18.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0681e-05 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004479+0000", 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3405999999999999e-05 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.819162401, 2024-09-18T10:31:18.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089699740000000003, 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 49 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995598+0000", 2024-09-18T10:31:18.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.495e-06 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995604+0000", 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4160000000000003e-06 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995607+0000", 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.439e-06 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000235+0000", 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046279570000000003 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000284+0000", 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8316000000000003e-05 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000364+0000", 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0117999999999994e-05 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002075+0000", 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001711064 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004511+0000", 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024360699999999998 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004542+0000", 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0998999999999999e-05 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004565+0000", 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3458000000000001e-05 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.819145150000001, 2024-09-18T10:31:18.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011464667, 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 50 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995612+0000", 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995711+0000", 2024-09-18T10:31:18.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8493999999999996e-05 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995719+0000", 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4160000000000004e-06 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995724+0000", 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000646+0000", 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049220560000000002 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000740+0000", 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4660999999999994e-05 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000883+0000", 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00014210199999999999 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002077+0000", 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011947150000000001 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007015+0000", 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049376560000000003 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007053+0000", 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8469e-05 2024-09-18T10:31:18.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007077+0000", 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3876999999999999e-05 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.81902672, 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011450287999999999, 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 51 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995730+0000", 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995735+0000", 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.938e-06 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995741+0000", 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995744+0000", 2024-09-18T10:31:18.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2729999999999998e-06 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001284+0000", 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00553982 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001354+0000", 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9439999999999999e-05 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001433+0000", 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9839000000000006e-05 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002242+0000", 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080809000000000002 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007122+0000", 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004880428 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007150+0000", 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8309999999999998e-05 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007181+0000", 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1059000000000002e-05 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.819008319, 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011502327, 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 52 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995754+0000", 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1610000000000002e-06 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995760+0000", 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995764+0000", 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6739999999999999e-06 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001659+0000", 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058952459999999998 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001742+0000", 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2378000000000003e-05 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001835+0000", 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3710999999999998e-05 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002405+0000", 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056997199999999997 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007206+0000", 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048005959999999999 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007231+0000", 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5449999999999999e-05 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007252+0000", 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0319e-05 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.684898809, 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010184168, 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 71 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129861+0000", 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1019999999999999e-06 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129864+0000", 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.898e-06 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129866+0000", 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0339999999999999e-06 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133579+0000", 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037133029999999998 2024-09-18T10:31:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133627+0000", 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7700000000000001e-05 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133711+0000", 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3752999999999996e-05 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136265+0000", 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025542759999999999 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.139993+0000", 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003728543 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140023+0000", 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0103999999999998e-05 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140043+0000", 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.684889433, 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286735, 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 72 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129937+0000", 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8833999999999999e-05 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129943+0000", 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6710000000000004e-06 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129946+0000", 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2480000000000001e-06 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133930+0000", 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039838319999999997 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133979+0000", 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9802999999999997e-05 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134057+0000", 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7226999999999998e-05 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136267+0000", 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022104440000000002 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140087+0000", 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038197069999999999 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140117+0000", 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0156000000000001e-05 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140155+0000", 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8019000000000003e-05 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.684807727000001, 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286248, 2024-09-18T10:31:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 73 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129952+0000", 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7420000000000002e-06 2024-09-18T10:31:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129956+0000", 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0289999999999999e-06 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129959+0000", 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134509+0000", 2024-09-18T10:31:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045500389999999996 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134554+0000", 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4984999999999997e-05 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134633+0000", 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8549999999999998e-05 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136269+0000", 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016365489999999999 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140192+0000", 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039229299999999998 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140217+0000", 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4992000000000001e-05 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140236+0000", 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.895e-05 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.684772893, 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010335796, 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 74 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129984+0000", 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129989+0000", 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5680000000000001e-06 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129995+0000", 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3350000000000003e-06 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129999+0000", 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9500000000000003e-06 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134856+0000", 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048568020000000003 2024-09-18T10:31:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134907+0000", 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1450999999999999e-05 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134984+0000", 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6379999999999997e-05 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136272+0000", 2024-09-18T10:31:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012878449999999999 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140264+0000", 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039928409999999996 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140289+0000", 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4652999999999999e-05 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140321+0000", 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1550000000000001e-05 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.684744493, 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.01270772, 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 75 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130094+0000", 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1198000000000004e-05 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130104+0000", 2024-09-18T10:31:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5789999999999993e-06 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130114+0000", 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0808000000000001e-05 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135231+0000", 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051164119999999999 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135281+0000", 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0305e-05 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135363+0000", 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2083999999999995e-05 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136275+0000", 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091162199999999995 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142660+0000", 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063848919999999997 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142698+0000", 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8804999999999999e-05 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142721+0000", 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2498e-05 2024-09-18T10:31:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.684635696000001, 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.015446817, 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 76 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130121+0000", 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130128+0000", 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.161e-06 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130135+0000", 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8189999999999992e-06 2024-09-18T10:31:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130139+0000", 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7340000000000002e-06 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135853+0000", 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057137840000000004 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135902+0000", 2024-09-18T10:31:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9461e-05 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135979+0000", 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6268999999999998e-05 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136467+0000", 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048846600000000001 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145517+0000", 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0090497459999999991 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145546+0000", 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9295999999999999e-05 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145569+0000", 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2697e-05 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:96 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.548886470999999, 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083996039999999998, 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 96 2024-09-18T10:31:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265918+0000", 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7209999999999997e-05 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265925+0000", 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9569999999999996e-06 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265928+0000", 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5429999999999998e-06 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268734+0000", 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028057780000000001 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268778+0000", 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3547000000000002e-05 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268845+0000", 2024-09-18T10:31:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7162999999999994e-05 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.271236+0000", 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023913910000000001 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274205+0000", 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0029687939999999999 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274241+0000", 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6041000000000003e-05 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274271+0000", 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9798000000000002e-05 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.548677832999999, 2024-09-18T10:31:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083023239999999998, 2024-09-18T10:31:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 98 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266082+0000", 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4990000000000001e-06 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266087+0000", 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4340000000000002e-06 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266089+0000", 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3690000000000001e-06 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.269815+0000", 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037263330000000001 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.269857+0000", 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1381999999999998e-05 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.269924+0000", 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7497999999999996e-05 2024-09-18T10:31:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.271281+0000", 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013569529999999999 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274329+0000", 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0030478150000000002 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274349+0000", 2024-09-18T10:31:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0021e-05 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274382+0000", 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3342e-05 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.54862923, 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083081249999999995, 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 99 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266128+0000", 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266201+0000", 2024-09-18T10:31:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2515999999999995e-05 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266205+0000", 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8130000000000003e-06 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266209+0000", 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5389999999999999e-06 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270099+0000", 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038896099999999999 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270142+0000", 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3142999999999997e-05 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270209+0000", 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.737e-05 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.914 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.272000+0000", 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001790795 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274386+0000", 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023865639999999999 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274407+0000", 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0856000000000002e-05 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274437+0000", 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9298999999999998e-05 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.420315606000001, 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091240130000000003, 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.916 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 121 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.917 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394445+0000", 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.292e-06 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394448+0000", 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0819999999999999e-06 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394450+0000", 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9420000000000002e-06 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399432+0000", 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049813349999999999 2024-09-18T10:31:18.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399474+0000", 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2061000000000003e-05 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399540+0000", 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6324999999999999e-05 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403485+0000", 2024-09-18T10:31:18.920 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039450300000000004 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403519+0000", 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3794000000000002e-05 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403547+0000", 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8195999999999999e-05 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.921 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403566+0000", 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9236999999999999e-05 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.420305117, 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0092440720000000007, 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.922 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 122 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:18.923 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394452+0000", 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394455+0000", 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.728e-06 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.924 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394460+0000", 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1089999999999997e-06 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394463+0000", 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0939999999999999e-06 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399744+0000", 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052808059999999999 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.925 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399814+0000", 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9710999999999997e-05 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399928+0000", 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000113885 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403609+0000", 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036813979999999998 2024-09-18T10:31:18.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403616+0000", 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7390000000000002e-06 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403658+0000", 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2373000000000002e-05 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403697+0000", 2024-09-18T10:31:18.927 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8435e-05 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.420282825999999, 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011099146000000001, 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.928 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 123 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394505+0000", 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0673999999999998e-05 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394511+0000", 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5539999999999997e-06 2024-09-18T10:31:18.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394513+0000", 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.52e-06 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400185+0000", 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056715170000000001 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400227+0000", 2024-09-18T10:31:18.931 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2512999999999998e-05 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400322+0000", 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4887000000000001e-05 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403719+0000", 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033967540000000001 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.932 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405497+0000", 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001778204 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405542+0000", 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4502000000000002e-05 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405574+0000", 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:31:18.933 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.42024067, 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.016509943999999999, 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:18.934 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 124 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.935 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394519+0000", 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.508e-06 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394522+0000", 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.83e-06 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394524+0000", 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.804e-06 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403059+0000", 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085345979999999991 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403129+0000", 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0043999999999995e-05 2024-09-18T10:31:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403245+0000", 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000116123 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.404743+0000", 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001498309 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410948+0000", 2024-09-18T10:31:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062045370000000004 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410993+0000", 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5629e-05 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.411027+0000", 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3827e-05 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:18.940 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:18.940 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:18.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:18.943 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:18.941+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:19.040 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:19.041 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:19.041 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:19.041 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:19.042 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:19.041+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:19.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:19.143 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:19.141+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:19.146 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:19.147 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:19.147 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:19.147 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:19.147 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:19.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:19.244 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:19.243+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:19.252 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-18T10:31:19.252 INFO:teuthology.orchestra.run.smithi063.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-18T10:31:19.299 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:19.299 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:19.299 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:19.299 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [] 2024-09-18T10:31:19.300 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:19.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:19.352 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:19.350+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:19.406 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:19.407 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:19.407 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:19.407 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:19.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:19.446 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:19.445+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:19.547 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:19.545+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:19.554 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:19.554 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:19.554 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:19.554 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:19.554 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:19.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:19.648 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:19.646+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4356.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:31:19.705 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:05.179335+0000", 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.525245125, 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028376339999999999, 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4356", 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:19.706 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179335+0000", 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179335+0000", 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179333+0000", 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.707 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179340+0000", 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9500000000000004e-06 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179348+0000", 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8059999999999995e-06 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.708 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179354+0000", 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5049999999999998e-06 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179624+0000", 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00027060099999999998 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.179630+0000", 2024-09-18T10:31:19.709 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8719999999999999e-06 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.181113+0000", 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001482822 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.181252+0000", 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00013939200000000001 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.710 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 5", 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.181379+0000", 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00012640700000000001 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.181899+0000", 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00052054900000000003 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182123+0000", 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00022403700000000001 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182152+0000", 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8938e-05 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182173+0000", 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0931e-05 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_repop_reply(client.4356.0:1 2.3 e27/26 ondisk, result = 0)", 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:05.182061+0000", 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.522519490000001, 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000117626, 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "started", 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182061+0000", 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.713 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:19.714 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182061+0000", 2024-09-18T10:31:19.714 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:19.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.714 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:19.714 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182061+0000", 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182065+0000", 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2050000000000004e-06 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182073+0000", 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1680000000000004e-06 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.715 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182081+0000", 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2619999999999998e-06 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182116+0000", 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4532000000000001e-05 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182120+0000", 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6659999999999999e-06 2024-09-18T10:31:19.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:05.182179+0000", 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8349e-05 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:19.717 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:19.718 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:19.762 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:19.761+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:19.828 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:19.829 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:19.829 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:19.829 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:19.837 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:19.850 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:19.850+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:19.951 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:19.950+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:19.976 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:19.976 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:19.976 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:19.977 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:19.977 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:19.985 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:20.052 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:20.051+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:20.083 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:20.083 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:20.083 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:20.083 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [] 2024-09-18T10:31:20.083 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:20.091 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:20.153 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:20.152+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:20.189 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:20.189 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:31:20.208 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:20.229 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:20.230 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:20.230 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:20.230 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:20.238 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:20.255 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:20.254+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:20.281 DEBUG:teuthology.orchestra.run.smithi160:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-09-18T10:31:20.281 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-09-18T10:31:20.281 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-09-18T10:31:20.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight read -> 100 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight delete -> 50 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight snap_create -> 50 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight snap_remove -> 50 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight rollback -> 50 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight setattr -> 25 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight rmattr -> 25 2024-09-18T10:31:20.306 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight copy_from -> 50 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout:adding op weight append -> 100 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout:ceph version 17.2.7-1645-g7061ea6c (7061ea6ca50908d104e9f3979dc615e118d9e153) quincy (stable) 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout:Configuration: 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout: Number of operations: 400 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout: Number of objects: 50 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout: Max in flight operations: 16 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout: Object size (in bytes): 4000000 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout: Write stride min: 400000 2024-09-18T10:31:20.307 INFO:tasks.rados.rados.0.smithi160.stdout: Write stride max: 800000 2024-09-18T10:31:20.338 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:20.339 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:20.339 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:20.339 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:20.339 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:20.347 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:20.348 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:20.354 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:20.353+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:20.364 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:20.364 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:20.381 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:20.382 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:20.400 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:20.401 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:20.416 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:20.417 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:20.431 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:20.431 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:20.455 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:20.455 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:20.456 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:20.453+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:20.470 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:20.471 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:20.485 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:20.485 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:20.485 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:20.486 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:20.493 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:20.501 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:20.502 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:20.517 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:20.533 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:20.548 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:20.556 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:20.554+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:20.564 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:20.581 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:20.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:20.580+0000 7fe59a8fa640 0 -- 172.21.15.63:0/452976235 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7fe594195b70 msgr2=0x7fe594197f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-18T10:31:20.253580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":46,"acting":46,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":15,"kb":1509949440,"kb_used":4762636,"kb_used_data":4928,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505186804,"statfs":{"total":1546188226560,"available":1541311287296,"internally_reserved":0,"allocated":5046272,"data_stored":3388964,"data_compressed":423851,"data_compressed_allocated":638976,"data_compressed_original":2170880,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029668"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.660093+0000","last_change":"2024-09-18T10:31:19.660093+0000","last_active":"2024-09-18T10:31:19.660093+0000","last_peered":"2024-09-18T10:31:19.660093+0000","last_clean":"2024-09-18T10:31:19.660093+0000","last_became_active":"2024-09-18T10:31:19.659120+0000","last_became_peered":"2024-09-18T10:31:19.659120+0000","last_unstale":"2024-09-18T10:31:19.660093+0000","last_undegraded":"2024-09-18T10:31:19.660093+0000","last_fullsized":"2024-09-18T10:31:19.660093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.157665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"26'112","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-18T10:31:07.426126+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:07.426126+0000","last_peered":"2024-09-18T10:31:07.426126+0000","last_clean":"2024-09-18T10:31:07.426126+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:07.426126+0000","last_undegraded":"2024-09-18T10:31:07.426126+0000","last_fullsized":"2024-09-18T10:31:07.426126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.771951+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:12.771951+0000","last_peered":"2024-09-18T10:31:12.771951+0000","last_clean":"2024-09-18T10:31:12.771951+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:12.771951+0000","last_undegraded":"2024-09-18T10:31:12.771951+0000","last_fullsized":"2024-09-18T10:31:12.771951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.771918+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:12.771918+0000","last_peered":"2024-09-18T10:31:12.771918+0000","last_clean":"2024-09-18T10:31:12.771918+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:12.771918+0000","last_undegraded":"2024-09-18T10:31:12.771918+0000","last_fullsized":"2024-09-18T10:31:12.771918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.657747+0000","last_change":"2024-09-18T10:31:19.657747+0000","last_active":"2024-09-18T10:31:19.657747+0000","last_peered":"2024-09-18T10:31:19.657747+0000","last_clean":"2024-09-18T10:31:19.657747+0000","last_became_active":"2024-09-18T10:31:19.657050+0000","last_became_peered":"2024-09-18T10:31:19.657050+0000","last_unstale":"2024-09-18T10:31:19.657747+0000","last_undegraded":"2024-09-18T10:31:19.657747+0000","last_fullsized":"2024-09-18T10:31:19.657747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.836363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.771949+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:12.771949+0000","last_peered":"2024-09-18T10:31:12.771949+0000","last_clean":"2024-09-18T10:31:12.771949+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:12.771949+0000","last_undegraded":"2024-09-18T10:31:12.771949+0000","last_fullsized":"2024-09-18T10:31:12.771949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.771915+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:12.771915+0000","last_peered":"2024-09-18T10:31:12.771915+0000","last_clean":"2024-09-18T10:31:12.771915+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:12.771915+0000","last_undegraded":"2024-09-18T10:31:12.771915+0000","last_fullsized":"2024-09-18T10:31:12.771915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-18T10:31:18.253686+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:18.253686+0000","last_peered":"2024-09-18T10:31:18.253686+0000","last_clean":"2024-09-18T10:31:18.253686+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:18.253686+0000","last_undegraded":"2024-09-18T10:31:18.253686+0000","last_fullsized":"2024-09-18T10:31:18.253686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-18T10:31:18.229845+0000","last_change":"2024-09-18T10:31:18.229845+0000","last_active":"2024-09-18T10:31:18.229845+0000","last_peered":"2024-09-18T10:31:18.229845+0000","last_clean":"2024-09-18T10:31:18.229845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-18T10:31:18.229845+0000","last_undegraded":"2024-09-18T10:31:18.229845+0000","last_fullsized":"2024-09-18T10:31:18.229845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.585386+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:12.585386+0000","last_peered":"2024-09-18T10:31:12.585386+0000","last_clean":"2024-09-18T10:31:12.585386+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:12.585386+0000","last_undegraded":"2024-09-18T10:31:12.585386+0000","last_fullsized":"2024-09-18T10:31:12.585386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.260875+0000","last_change":"2024-09-18T10:31:19.260875+0000","last_active":"2024-09-18T10:31:19.260875+0000","last_peered":"2024-09-18T10:31:19.260875+0000","last_clean":"2024-09-18T10:31:19.260875+0000","last_became_active":"2024-09-18T10:31:19.259917+0000","last_became_peered":"2024-09-18T10:31:19.259917+0000","last_unstale":"2024-09-18T10:31:19.260875+0000","last_undegraded":"2024-09-18T10:31:19.260875+0000","last_fullsized":"2024-09-18T10:31:19.260875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.414788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.771681+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:12.771681+0000","last_peered":"2024-09-18T10:31:12.771681+0000","last_clean":"2024-09-18T10:31:12.771681+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:12.771681+0000","last_undegraded":"2024-09-18T10:31:12.771681+0000","last_fullsized":"2024-09-18T10:31:12.771681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.657316+0000","last_change":"2024-09-18T10:31:19.657316+0000","last_active":"2024-09-18T10:31:19.657316+0000","last_peered":"2024-09-18T10:31:19.657316+0000","last_clean":"2024-09-18T10:31:19.657316+0000","last_became_active":"2024-09-18T10:31:19.653910+0000","last_became_peered":"2024-09-18T10:31:19.653910+0000","last_unstale":"2024-09-18T10:31:19.657316+0000","last_undegraded":"2024-09-18T10:31:19.657316+0000","last_fullsized":"2024-09-18T10:31:19.657316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.757231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-18T10:31:12.771912+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:12.771912+0000","last_peered":"2024-09-18T10:31:12.771912+0000","last_clean":"2024-09-18T10:31:12.771912+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:12.771912+0000","last_undegraded":"2024-09-18T10:31:12.771912+0000","last_fullsized":"2024-09-18T10:31:12.771912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":28,"acting":28,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":352256,"data_stored":666959,"data_compressed":32953,"data_compressed_allocated":65536,"data_compressed_original":577536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":14,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":13,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":303104,"data_stored":138050,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":0,"up_from":21,"seq":90194313223,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,5,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":1,"up_from":21,"seq":90194313224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":4,"up_from":21,"seq":90194313224,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":2,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,5,6,7,8,9,10,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":5,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":6,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":352256,"data_stored":666959,"data_compressed":32953,"data_compressed_allocated":65536,"data_compressed_original":577536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":7,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[4,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":8,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[3,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":9,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":299008,"data_stored":138031,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":12,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":303104,"data_stored":138050,"data_compressed":23028,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:20.585 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-09-18T10:31:20.592 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:20.592 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:20.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:20.657 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:20.656+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:20.698 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:20.698 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:20.706 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:20.759 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:20.758+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:20.798 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:20.798 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:20.845 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:20.846 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:20.854 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:31:20.860 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:20.859+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:20.951 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:20.952 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:20.960 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:31:20.961 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:20.961+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:21.060 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.060 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.062 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:21.061+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:21.068 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:31:21.164 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:21.163+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:21.166 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.166 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:21.261 INFO:tasks.rados.rados.0.smithi160.stdout:1: write initial oid 1 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:1: seq_num 0 ranges {0=32768} 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:1: writing smithi16036501-1 from 0 to 32768 tid 1 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:2: write initial oid 2 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:2: seq_num 1 ranges {0=32768} 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:2: writing smithi16036501-2 from 0 to 32768 tid 1 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:3: write initial oid 3 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:3: seq_num 2 ranges {0=49152} 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:3: writing smithi16036501-3 from 0 to 49152 tid 1 2024-09-18T10:31:21.262 INFO:tasks.rados.rados.0.smithi160.stdout:4: write initial oid 4 2024-09-18T10:31:21.263 INFO:tasks.rados.rados.0.smithi160.stdout:4: seq_num 3 ranges {0=65536} 2024-09-18T10:31:21.263 INFO:tasks.rados.rados.0.smithi160.stdout:4: writing smithi16036501-4 from 0 to 65536 tid 1 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:5: write initial oid 5 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:5: seq_num 4 ranges {0=81920} 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:5: writing smithi16036501-5 from 0 to 81920 tid 1 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:6: write initial oid 6 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:6: seq_num 5 ranges {0=98304} 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:6: writing smithi16036501-6 from 0 to 98304 tid 1 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:7: write initial oid 7 2024-09-18T10:31:21.264 INFO:tasks.rados.rados.0.smithi160.stdout:7: seq_num 6 ranges {0=114688} 2024-09-18T10:31:21.265 INFO:tasks.rados.rados.0.smithi160.stdout:7: writing smithi16036501-7 from 0 to 114688 tid 1 2024-09-18T10:31:21.265 INFO:tasks.rados.rados.0.smithi160.stdout:8: write initial oid 8 2024-09-18T10:31:21.265 INFO:tasks.rados.rados.0.smithi160.stdout:8: seq_num 7 ranges {0=131072} 2024-09-18T10:31:21.265 INFO:tasks.rados.rados.0.smithi160.stdout:8: writing smithi16036501-8 from 0 to 131072 tid 1 2024-09-18T10:31:21.266 INFO:tasks.rados.rados.0.smithi160.stdout:9: write initial oid 9 2024-09-18T10:31:21.266 INFO:tasks.rados.rados.0.smithi160.stdout:9: seq_num 8 ranges {0=147456} 2024-09-18T10:31:21.266 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:21.263+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:21.266 INFO:tasks.rados.rados.0.smithi160.stdout:9: writing smithi16036501-9 from 0 to 147456 tid 1 2024-09-18T10:31:21.267 INFO:tasks.rados.rados.0.smithi160.stdout:10: write initial oid 10 2024-09-18T10:31:21.267 INFO:tasks.rados.rados.0.smithi160.stdout:10: seq_num 9 ranges {0=163840} 2024-09-18T10:31:21.267 INFO:tasks.rados.rados.0.smithi160.stdout:10: writing smithi16036501-10 from 0 to 163840 tid 1 2024-09-18T10:31:21.268 INFO:tasks.rados.rados.0.smithi160.stdout:11: write initial oid 11 2024-09-18T10:31:21.268 INFO:tasks.rados.rados.0.smithi160.stdout:11: seq_num 10 ranges {0=180224} 2024-09-18T10:31:21.269 INFO:tasks.rados.rados.0.smithi160.stdout:11: writing smithi16036501-11 from 0 to 180224 tid 1 2024-09-18T10:31:21.269 INFO:tasks.rados.rados.0.smithi160.stdout:12: write initial oid 12 2024-09-18T10:31:21.269 INFO:tasks.rados.rados.0.smithi160.stdout:12: seq_num 11 ranges {0=196608} 2024-09-18T10:31:21.270 INFO:tasks.rados.rados.0.smithi160.stdout:12: writing smithi16036501-12 from 0 to 196608 tid 1 2024-09-18T10:31:21.271 INFO:tasks.rados.rados.0.smithi160.stdout:13: write initial oid 13 2024-09-18T10:31:21.271 INFO:tasks.rados.rados.0.smithi160.stdout:13: seq_num 12 ranges {0=212992} 2024-09-18T10:31:21.272 INFO:tasks.rados.rados.0.smithi160.stdout:13: writing smithi16036501-13 from 0 to 212992 tid 1 2024-09-18T10:31:21.272 INFO:tasks.rados.rados.0.smithi160.stdout:14: write initial oid 14 2024-09-18T10:31:21.272 INFO:tasks.rados.rados.0.smithi160.stdout:14: seq_num 13 ranges {0=229376} 2024-09-18T10:31:21.274 INFO:tasks.rados.rados.0.smithi160.stdout:14: writing smithi16036501-14 from 0 to 229376 tid 1 2024-09-18T10:31:21.274 INFO:tasks.rados.rados.0.smithi160.stdout:15: write initial oid 15 2024-09-18T10:31:21.274 INFO:tasks.rados.rados.0.smithi160.stdout:15: seq_num 14 ranges {0=245760} 2024-09-18T10:31:21.276 INFO:tasks.rados.rados.0.smithi160.stdout:15: writing smithi16036501-15 from 0 to 245760 tid 1 2024-09-18T10:31:21.276 INFO:tasks.rados.rados.0.smithi160.stdout:16: write initial oid 16 2024-09-18T10:31:21.276 INFO:tasks.rados.rados.0.smithi160.stdout:16: seq_num 15 ranges {0=262144} 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:16: writing smithi16036501-16 from 0 to 262144 tid 1 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:2: finishing write tid 1 to smithi16036501-2 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:1: finishing write tid 1 to smithi16036501-1 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:2: finishing write tid 2 to smithi16036501-2 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:3: finishing write tid 1 to smithi16036501-3 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:7: finishing write tid 1 to smithi16036501-7 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:7: finishing write tid 2 to smithi16036501-7 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:2: finishing write tid 3 to smithi16036501-2 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-09-18T10:31:21.279 INFO:tasks.rados.rados.0.smithi160.stdout:4: finishing write tid 1 to smithi16036501-4 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:4: finishing write tid 2 to smithi16036501-4 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:7: finishing write tid 3 to smithi16036501-7 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:2: done (15 left) 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:7: done (14 left) 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:17: write initial oid 17 2024-09-18T10:31:21.280 INFO:tasks.rados.rados.0.smithi160.stdout:17: seq_num 16 ranges {0=278528} 2024-09-18T10:31:21.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:17: writing smithi16036501-17 from 0 to 278528 tid 1 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:18: write initial oid 18 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:1: finishing write tid 2 to smithi16036501-1 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:3: finishing write tid 2 to smithi16036501-3 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:10: finishing write tid 1 to smithi16036501-10 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:4: finishing write tid 3 to smithi16036501-4 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:1: finishing write tid 3 to smithi16036501-1 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-09-18T10:31:21.282 INFO:tasks.rados.rados.0.smithi160.stdout:5: finishing write tid 1 to smithi16036501-5 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:3: finishing write tid 3 to smithi16036501-3 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:5: finishing write tid 2 to smithi16036501-5 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:9: finishing write tid 1 to smithi16036501-9 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:9: finishing write tid 2 to smithi16036501-9 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:10: finishing write tid 2 to smithi16036501-10 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:6: finishing write tid 1 to smithi16036501-6 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:6: finishing write tid 2 to smithi16036501-6 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:8: finishing write tid 1 to smithi16036501-8 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:12: finishing write tid 1 to smithi16036501-12 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:12: finishing write tid 2 to smithi16036501-12 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:9: finishing write tid 3 to smithi16036501-9 2024-09-18T10:31:21.283 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 9 v 2 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-18T10:31:21.284 INFO:tasks.rados.rados.0.smithi160.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-09-18T10:31:21.284 INFO:tasks.rados.rados.0.smithi160.stdout:8: finishing write tid 2 to smithi16036501-8 2024-09-18T10:31:21.284 INFO:tasks.rados.rados.0.smithi160.stdout:5: finishing write tid 3 to smithi16036501-5 2024-09-18T10:31:21.284 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-18T10:31:21.284 INFO:tasks.rados.rados.0.smithi160.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-09-18T10:31:21.284 INFO:tasks.rados.rados.0.smithi160.stdout:18: seq_num 17 ranges {0=294912} 2024-09-18T10:31:21.285 INFO:tasks.rados.rados.0.smithi160.stdout:18: writing smithi16036501-18 from 0 to 294912 tid 1 2024-09-18T10:31:21.285 INFO:tasks.rados.rados.0.smithi160.stdout:1: done (15 left) 2024-09-18T10:31:21.285 INFO:tasks.rados.rados.0.smithi160.stdout:3: done (14 left) 2024-09-18T10:31:21.285 INFO:tasks.rados.rados.0.smithi160.stdout:4: done (13 left) 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:5: done (12 left) 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:9: done (11 left) 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:19: write initial oid 19 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:19: seq_num 18 ranges {0=311296} 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:19: writing smithi16036501-19 from 0 to 311296 tid 1 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:20: write initial oid 20 2024-09-18T10:31:21.286 INFO:tasks.rados.rados.0.smithi160.stdout:20: seq_num 19 ranges {0=327680} 2024-09-18T10:31:21.287 INFO:tasks.rados.rados.0.smithi160.stdout:20: writing smithi16036501-20 from 0 to 327680 tid 1 2024-09-18T10:31:21.287 INFO:tasks.rados.rados.0.smithi160.stdout:21: write initial oid 21 2024-09-18T10:31:21.287 INFO:tasks.rados.rados.0.smithi160.stdout:21: seq_num 20 ranges {0=344064} 2024-09-18T10:31:21.289 INFO:tasks.rados.rados.0.smithi160.stdout:21: writing smithi16036501-21 from 0 to 344064 tid 1 2024-09-18T10:31:21.289 INFO:tasks.rados.rados.0.smithi160.stdout:22: write initial oid 22 2024-09-18T10:31:21.289 INFO:tasks.rados.rados.0.smithi160.stdout:22: seq_num 21 ranges {0=360448} 2024-09-18T10:31:21.291 INFO:tasks.rados.rados.0.smithi160.stdout:22: writing smithi16036501-22 from 0 to 360448 tid 1 2024-09-18T10:31:21.292 INFO:tasks.rados.rados.0.smithi160.stdout:23: write initial oid 23 2024-09-18T10:31:21.292 INFO:tasks.rados.rados.0.smithi160.stdout:23: seq_num 22 ranges {0=376832} 2024-09-18T10:31:21.294 INFO:tasks.rados.rados.0.smithi160.stdout:23: writing smithi16036501-23 from 0 to 376832 tid 1 2024-09-18T10:31:21.294 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.294 INFO:tasks.rados.rados.0.smithi160.stdout:10: finishing write tid 3 to smithi16036501-10 2024-09-18T10:31:21.294 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 10 v 4 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-18T10:31:21.294 INFO:tasks.rados.rados.0.smithi160.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-09-18T10:31:21.294 INFO:tasks.rados.rados.0.smithi160.stdout:13: finishing write tid 1 to smithi16036501-13 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:6: finishing write tid 3 to smithi16036501-6 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:12: finishing write tid 3 to smithi16036501-12 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 12 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:11: finishing write tid 1 to smithi16036501-11 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:13: finishing write tid 2 to smithi16036501-13 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:11: finishing write tid 2 to smithi16036501-11 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:14: finishing write tid 1 to smithi16036501-14 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:8: finishing write tid 3 to smithi16036501-8 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 8 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-09-18T10:31:21.295 INFO:tasks.rados.rados.0.smithi160.stdout:15: finishing write tid 1 to smithi16036501-15 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:15: finishing write tid 2 to smithi16036501-15 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:14: finishing write tid 2 to smithi16036501-14 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:6: done (15 left) 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:8: done (14 left) 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:10: done (13 left) 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:12: done (12 left) 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:24: write initial oid 24 2024-09-18T10:31:21.296 INFO:tasks.rados.rados.0.smithi160.stdout:24: seq_num 23 ranges {0=393216} 2024-09-18T10:31:21.297 INFO:tasks.rados.rados.0.smithi160.stdout:24: writing smithi16036501-24 from 0 to 393216 tid 1 2024-09-18T10:31:21.297 INFO:tasks.rados.rados.0.smithi160.stdout:25: write initial oid 25 2024-09-18T10:31:21.297 INFO:tasks.rados.rados.0.smithi160.stdout:25: seq_num 24 ranges {0=409600} 2024-09-18T10:31:21.299 INFO:tasks.rados.rados.0.smithi160.stdout:25: writing smithi16036501-25 from 0 to 409600 tid 1 2024-09-18T10:31:21.299 INFO:tasks.rados.rados.0.smithi160.stdout:26: write initial oid 26 2024-09-18T10:31:21.299 INFO:tasks.rados.rados.0.smithi160.stdout:26: seq_num 25 ranges {0=425984} 2024-09-18T10:31:21.301 INFO:tasks.rados.rados.0.smithi160.stdout:26: writing smithi16036501-26 from 0 to 425984 tid 1 2024-09-18T10:31:21.301 INFO:tasks.rados.rados.0.smithi160.stdout:27: write initial oid 27 2024-09-18T10:31:21.301 INFO:tasks.rados.rados.0.smithi160.stdout:27: seq_num 26 ranges {0=442368} 2024-09-18T10:31:21.302 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.302 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.304 INFO:tasks.rados.rados.0.smithi160.stdout:27: writing smithi16036501-27 from 0 to 442368 tid 1 2024-09-18T10:31:21.304 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.304 INFO:tasks.rados.rados.0.smithi160.stdout:13: finishing write tid 3 to smithi16036501-13 2024-09-18T10:31:21.304 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 13 v 6 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-18T10:31:21.304 INFO:tasks.rados.rados.0.smithi160.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-09-18T10:31:21.305 INFO:tasks.rados.rados.0.smithi160.stdout:13: done (15 left) 2024-09-18T10:31:21.305 INFO:tasks.rados.rados.0.smithi160.stdout:28: write initial oid 28 2024-09-18T10:31:21.305 INFO:tasks.rados.rados.0.smithi160.stdout:28: seq_num 27 ranges {0=458752} 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:28: writing smithi16036501-28 from 0 to 458752 tid 1 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:16: finishing write tid 1 to smithi16036501-16 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:15: finishing write tid 3 to smithi16036501-15 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 15 v 4 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:17: finishing write tid 1 to smithi16036501-17 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:17: finishing write tid 2 to smithi16036501-17 2024-09-18T10:31:21.307 INFO:tasks.rados.rados.0.smithi160.stdout:11: finishing write tid 3 to smithi16036501-11 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:14: finishing write tid 3 to smithi16036501-14 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 14 v 4 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:11: done (15 left) 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:14: done (14 left) 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:15: done (13 left) 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:29: write initial oid 29 2024-09-18T10:31:21.308 INFO:tasks.rados.rados.0.smithi160.stdout:29: seq_num 28 ranges {0=475136} 2024-09-18T10:31:21.310 INFO:tasks.rados.rados.0.smithi160.stdout:29: writing smithi16036501-29 from 0 to 475136 tid 1 2024-09-18T10:31:21.310 INFO:tasks.rados.rados.0.smithi160.stdout:30: write initial oid 30 2024-09-18T10:31:21.310 INFO:tasks.rados.rados.0.smithi160.stdout:30: seq_num 29 ranges {0=491520} 2024-09-18T10:31:21.313 INFO:tasks.rados.rados.0.smithi160.stdout:30: writing smithi16036501-30 from 0 to 491520 tid 1 2024-09-18T10:31:21.313 INFO:tasks.rados.rados.0.smithi160.stdout:31: write initial oid 31 2024-09-18T10:31:21.313 INFO:tasks.rados.rados.0.smithi160.stdout:31: seq_num 30 ranges {0=507904} 2024-09-18T10:31:21.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:21.317 INFO:tasks.rados.rados.0.smithi160.stdout:31: writing smithi16036501-31 from 0 to 507904 tid 1 2024-09-18T10:31:21.317 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.317 INFO:tasks.rados.rados.0.smithi160.stdout:17: finishing write tid 3 to smithi16036501-17 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 4 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:16: finishing write tid 2 to smithi16036501-16 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:18: finishing write tid 1 to smithi16036501-18 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:17: done (15 left) 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:32: write initial oid 32 2024-09-18T10:31:21.318 INFO:tasks.rados.rados.0.smithi160.stdout:32: seq_num 31 ranges {0=524288} 2024-09-18T10:31:21.319 INFO:tasks.rados.rados.0.smithi160.stdout:32: writing smithi16036501-32 from 0 to 524288 tid 1 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:18: finishing write tid 2 to smithi16036501-18 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:19: finishing write tid 1 to smithi16036501-19 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:16: finishing write tid 3 to smithi16036501-16 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 6 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:18: finishing write tid 3 to smithi16036501-18 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 18 v 2 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:19: finishing write tid 2 to smithi16036501-19 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:20: finishing write tid 1 to smithi16036501-20 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:22: finishing write tid 1 to smithi16036501-22 2024-09-18T10:31:21.320 INFO:tasks.rados.rados.0.smithi160.stdout:22: finishing write tid 2 to smithi16036501-22 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:19: finishing write tid 3 to smithi16036501-19 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 4 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:20: finishing write tid 2 to smithi16036501-20 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:21: finishing write tid 1 to smithi16036501-21 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:16: done (15 left) 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:18: done (14 left) 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:19: done (13 left) 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:33: write initial oid 33 2024-09-18T10:31:21.321 INFO:tasks.rados.rados.0.smithi160.stdout:33: seq_num 32 ranges {0=540672} 2024-09-18T10:31:21.323 INFO:tasks.rados.rados.0.smithi160.stdout:33: writing smithi16036501-33 from 0 to 540672 tid 1 2024-09-18T10:31:21.323 INFO:tasks.rados.rados.0.smithi160.stdout:34: write initial oid 34 2024-09-18T10:31:21.323 INFO:tasks.rados.rados.0.smithi160.stdout:34: seq_num 33 ranges {0=557056} 2024-09-18T10:31:21.326 INFO:tasks.rados.rados.0.smithi160.stdout:34: writing smithi16036501-34 from 0 to 557056 tid 1 2024-09-18T10:31:21.326 INFO:tasks.rados.rados.0.smithi160.stdout:35: write initial oid 35 2024-09-18T10:31:21.326 INFO:tasks.rados.rados.0.smithi160.stdout:35: seq_num 34 ranges {0=573440} 2024-09-18T10:31:21.330 INFO:tasks.rados.rados.0.smithi160.stdout:35: writing smithi16036501-35 from 0 to 573440 tid 1 2024-09-18T10:31:21.330 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.330 INFO:tasks.rados.rados.0.smithi160.stdout:21: finishing write tid 2 to smithi16036501-21 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:22: finishing write tid 3 to smithi16036501-22 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:23: finishing write tid 1 to smithi16036501-23 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:23: finishing write tid 2 to smithi16036501-23 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:25: finishing write tid 1 to smithi16036501-25 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:25: finishing write tid 2 to smithi16036501-25 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:24: finishing write tid 1 to smithi16036501-24 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:26: finishing write tid 1 to smithi16036501-26 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:20: finishing write tid 3 to smithi16036501-20 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 20 v 2 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-09-18T10:31:21.331 INFO:tasks.rados.rados.0.smithi160.stdout:21: finishing write tid 3 to smithi16036501-21 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 21 v 4 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:24: finishing write tid 2 to smithi16036501-24 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:20: done (15 left) 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:21: done (14 left) 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:22: done (13 left) 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:36: write initial oid 36 2024-09-18T10:31:21.332 INFO:tasks.rados.rados.0.smithi160.stdout:36: seq_num 35 ranges {0=589824} 2024-09-18T10:31:21.335 INFO:tasks.rados.rados.0.smithi160.stdout:36: writing smithi16036501-36 from 0 to 589824 tid 1 2024-09-18T10:31:21.335 INFO:tasks.rados.rados.0.smithi160.stdout:37: write initial oid 37 2024-09-18T10:31:21.335 INFO:tasks.rados.rados.0.smithi160.stdout:37: seq_num 36 ranges {0=606208} 2024-09-18T10:31:21.338 INFO:tasks.rados.rados.0.smithi160.stdout:37: writing smithi16036501-37 from 0 to 606208 tid 1 2024-09-18T10:31:21.338 INFO:tasks.rados.rados.0.smithi160.stdout:38: write initial oid 38 2024-09-18T10:31:21.338 INFO:tasks.rados.rados.0.smithi160.stdout:38: seq_num 37 ranges {0=622592} 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:38: writing smithi16036501-38 from 0 to 622592 tid 1 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:26: finishing write tid 2 to smithi16036501-26 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:23: finishing write tid 3 to smithi16036501-23 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:25: finishing write tid 3 to smithi16036501-25 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 25 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:24: finishing write tid 3 to smithi16036501-24 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 24 v 6 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-09-18T10:31:21.342 INFO:tasks.rados.rados.0.smithi160.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:26: finishing write tid 3 to smithi16036501-26 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 26 v 8 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:27: finishing write tid 1 to smithi16036501-27 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:23: done (15 left) 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:24: done (14 left) 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:25: done (13 left) 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:26: done (12 left) 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:39: write initial oid 39 2024-09-18T10:31:21.343 INFO:tasks.rados.rados.0.smithi160.stdout:39: seq_num 38 ranges {0=638976} 2024-09-18T10:31:21.345 INFO:tasks.rados.rados.0.smithi160.stdout:39: writing smithi16036501-39 from 0 to 638976 tid 1 2024-09-18T10:31:21.345 INFO:tasks.rados.rados.0.smithi160.stdout:40: write initial oid 40 2024-09-18T10:31:21.345 INFO:tasks.rados.rados.0.smithi160.stdout:40: seq_num 39 ranges {0=671744} 2024-09-18T10:31:21.350 INFO:tasks.rados.rados.0.smithi160.stdout:40: writing smithi16036501-40 from 0 to 671744 tid 1 2024-09-18T10:31:21.350 INFO:tasks.rados.rados.0.smithi160.stdout:41: write initial oid 41 2024-09-18T10:31:21.350 INFO:tasks.rados.rados.0.smithi160.stdout:41: seq_num 40 ranges {0=688128} 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:41: writing smithi16036501-41 from 0 to 688128 tid 1 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:27: finishing write tid 2 to smithi16036501-27 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:27: finishing write tid 3 to smithi16036501-27 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 27 v 2 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:28: finishing write tid 1 to smithi16036501-28 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:28: finishing write tid 2 to smithi16036501-28 2024-09-18T10:31:21.355 INFO:tasks.rados.rados.0.smithi160.stdout:29: finishing write tid 1 to smithi16036501-29 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:29: finishing write tid 2 to smithi16036501-29 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:28: finishing write tid 3 to smithi16036501-28 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:29: finishing write tid 3 to smithi16036501-29 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 29 v 4 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:27: done (14 left) 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:28: done (13 left) 2024-09-18T10:31:21.356 INFO:tasks.rados.rados.0.smithi160.stdout:29: done (12 left) 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:42: write initial oid 42 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:30: finishing write tid 1 to smithi16036501-30 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:31: finishing write tid 1 to smithi16036501-31 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:31: finishing write tid 2 to smithi16036501-31 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:30: finishing write tid 2 to smithi16036501-30 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:30: finishing write tid 3 to smithi16036501-30 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 30 v 4 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-09-18T10:31:21.357 INFO:tasks.rados.rados.0.smithi160.stdout:42: seq_num 41 ranges {0=704512} 2024-09-18T10:31:21.358 INFO:tasks.rados.rados.0.smithi160.stdout:42: writing smithi16036501-42 from 0 to 704512 tid 1 2024-09-18T10:31:21.359 INFO:tasks.rados.rados.0.smithi160.stdout:30: done (12 left) 2024-09-18T10:31:21.359 INFO:tasks.rados.rados.0.smithi160.stdout:43: write initial oid 43 2024-09-18T10:31:21.359 INFO:tasks.rados.rados.0.smithi160.stdout:43: seq_num 42 ranges {0=720896} 2024-09-18T10:31:21.363 INFO:tasks.rados.rados.0.smithi160.stdout:43: writing smithi16036501-43 from 0 to 720896 tid 1 2024-09-18T10:31:21.363 INFO:tasks.rados.rados.0.smithi160.stdout:44: write initial oid 44 2024-09-18T10:31:21.363 INFO:tasks.rados.rados.0.smithi160.stdout:44: seq_num 43 ranges {0=737280} 2024-09-18T10:31:21.366 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:21.365+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:21.368 INFO:tasks.rados.rados.0.smithi160.stdout:44: writing smithi16036501-44 from 0 to 737280 tid 1 2024-09-18T10:31:21.368 INFO:tasks.rados.rados.0.smithi160.stdout:45: write initial oid 45 2024-09-18T10:31:21.368 INFO:tasks.rados.rados.0.smithi160.stdout:45: seq_num 44 ranges {0=753664} 2024-09-18T10:31:21.372 INFO:tasks.rados.rados.0.smithi160.stdout:45: writing smithi16036501-45 from 0 to 753664 tid 1 2024-09-18T10:31:21.372 INFO:tasks.rados.rados.0.smithi160.stdout:46: write initial oid 46 2024-09-18T10:31:21.372 INFO:tasks.rados.rados.0.smithi160.stdout:46: seq_num 45 ranges {0=770048} 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:46: writing smithi16036501-46 from 0 to 770048 tid 1 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:31: finishing write tid 3 to smithi16036501-31 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 31 v 8 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:32: finishing write tid 1 to smithi16036501-32 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:32: finishing write tid 2 to smithi16036501-32 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:33: finishing write tid 1 to smithi16036501-33 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:33: finishing write tid 2 to smithi16036501-33 2024-09-18T10:31:21.378 INFO:tasks.rados.rados.0.smithi160.stdout:32: finishing write tid 3 to smithi16036501-32 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 32 v 4 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:34: finishing write tid 1 to smithi16036501-34 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:34: finishing write tid 2 to smithi16036501-34 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:31: done (15 left) 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:32: done (14 left) 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:47: write initial oid 47 2024-09-18T10:31:21.379 INFO:tasks.rados.rados.0.smithi160.stdout:47: seq_num 46 ranges {0=786432} 2024-09-18T10:31:21.382 INFO:tasks.rados.rados.0.smithi160.stdout:47: writing smithi16036501-47 from 0 to 786432 tid 1 2024-09-18T10:31:21.382 INFO:tasks.rados.rados.0.smithi160.stdout:48: write initial oid 48 2024-09-18T10:31:21.382 INFO:tasks.rados.rados.0.smithi160.stdout:48: seq_num 47 ranges {0=425984,425984=376832} 2024-09-18T10:31:21.384 INFO:tasks.rados.rados.0.smithi160.stdout:48: writing smithi16036501-48 from 0 to 425984 tid 1 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:48: writing smithi16036501-48 from 425984 to 802816 tid 2 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:34: finishing write tid 3 to smithi16036501-34 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:33: finishing write tid 3 to smithi16036501-33 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 33 v 2 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:35: finishing write tid 1 to smithi16036501-35 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:33: done (15 left) 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:34: done (14 left) 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:49: write initial oid 49 2024-09-18T10:31:21.388 INFO:tasks.rados.rados.0.smithi160.stdout:49: seq_num 48 ranges {0=442368,442368=376832} 2024-09-18T10:31:21.390 INFO:tasks.rados.rados.0.smithi160.stdout:49: writing smithi16036501-49 from 0 to 442368 tid 1 2024-09-18T10:31:21.393 INFO:tasks.rados.rados.0.smithi160.stdout:49: writing smithi16036501-49 from 442368 to 819200 tid 2 2024-09-18T10:31:21.393 INFO:tasks.rados.rados.0.smithi160.stdout:50: write initial oid 50 2024-09-18T10:31:21.393 INFO:tasks.rados.rados.0.smithi160.stdout:50: seq_num 49 ranges {0=458752,458752=376832} 2024-09-18T10:31:21.396 INFO:tasks.rados.rados.0.smithi160.stdout:50: writing smithi16036501-50 from 0 to 458752 tid 1 2024-09-18T10:31:21.398 INFO:tasks.rados.rados.0.smithi160.stdout:50: writing smithi16036501-50 from 458752 to 835584 tid 2 2024-09-18T10:31:21.398 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 16 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:35: finishing write tid 2 to smithi16036501-35 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:35: finishing write tid 3 to smithi16036501-35 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:36: finishing write tid 1 to smithi16036501-36 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:36: finishing write tid 2 to smithi16036501-36 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:37: finishing write tid 1 to smithi16036501-37 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:37: finishing write tid 2 to smithi16036501-37 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:37: finishing write tid 3 to smithi16036501-37 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 10 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:36: finishing write tid 3 to smithi16036501-36 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 36 v 8 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-18T10:31:21.399 INFO:tasks.rados.rados.0.smithi160.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:38: finishing write tid 1 to smithi16036501-38 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:38: finishing write tid 2 to smithi16036501-38 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:38: finishing write tid 3 to smithi16036501-38 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 8 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:39: finishing write tid 1 to smithi16036501-39 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:39: finishing write tid 2 to smithi16036501-39 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:39: finishing write tid 3 to smithi16036501-39 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 39 v 8 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:40: finishing write tid 1 to smithi16036501-40 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:40: finishing write tid 2 to smithi16036501-40 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:40: finishing write tid 3 to smithi16036501-40 2024-09-18T10:31:21.400 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 40 v 8 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:35: done (15 left) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:36: done (14 left) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:37: done (13 left) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:38: done (12 left) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:39: done (11 left) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:40: done (10 left) 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 1 current snap is 0 2024-09-18T10:31:21.401 INFO:tasks.rados.rados.0.smithi160.stdout:51: seq_num 50 ranges {32768=475136,507904=376832} 2024-09-18T10:31:21.402 INFO:tasks.rados.rados.0.smithi160.stdout:51: writing smithi16036501-1 from 32768 to 507904 tid 1 2024-09-18T10:31:21.404 INFO:tasks.rados.rados.0.smithi160.stdout:51: writing smithi16036501-1 from 507904 to 884736 tid 2 2024-09-18T10:31:21.404 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 19 current snap is 0 2024-09-18T10:31:21.405 INFO:tasks.rados.rados.0.smithi160.stdout:41: finishing write tid 1 to smithi16036501-41 2024-09-18T10:31:21.405 INFO:tasks.rados.rados.0.smithi160.stdout:41: finishing write tid 2 to smithi16036501-41 2024-09-18T10:31:21.405 INFO:tasks.rados.rados.0.smithi160.stdout:42: finishing write tid 1 to smithi16036501-42 2024-09-18T10:31:21.405 INFO:tasks.rados.rados.0.smithi160.stdout:42: finishing write tid 2 to smithi16036501-42 2024-09-18T10:31:21.405 INFO:tasks.rados.rados.0.smithi160.stdout:52: seq_num 51 ranges {311296=491520,802816=376832} 2024-09-18T10:31:21.409 INFO:tasks.rados.rados.0.smithi160.stdout:52: writing smithi16036501-19 from 311296 to 802816 tid 1 2024-09-18T10:31:21.412 INFO:tasks.rados.rados.0.smithi160.stdout:52: writing smithi16036501-19 from 802816 to 1179648 tid 2 2024-09-18T10:31:21.412 INFO:tasks.rados.rados.0.smithi160.stdout:53: delete oid 24 current snap is 0 2024-09-18T10:31:21.412 INFO:tasks.rados.rados.0.smithi160.stdout:42: finishing write tid 3 to smithi16036501-42 2024-09-18T10:31:21.412 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 42 v 10 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:41: finishing write tid 3 to smithi16036501-41 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 41 v 10 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:43: finishing write tid 1 to smithi16036501-43 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:43: finishing write tid 2 to smithi16036501-43 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:43: finishing write tid 3 to smithi16036501-43 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 43 v 12 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:44: finishing write tid 1 to smithi16036501-44 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:44: finishing write tid 2 to smithi16036501-44 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:44: finishing write tid 3 to smithi16036501-44 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 44 v 10 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-09-18T10:31:21.413 INFO:tasks.rados.rados.0.smithi160.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-09-18T10:31:21.414 INFO:tasks.rados.rados.0.smithi160.stdout:45: finishing write tid 1 to smithi16036501-45 2024-09-18T10:31:21.414 INFO:tasks.rados.rados.0.smithi160.stdout:45: finishing write tid 2 to smithi16036501-45 2024-09-18T10:31:21.414 INFO:tasks.rados.rados.0.smithi160.stdout:45: finishing write tid 3 to smithi16036501-45 2024-09-18T10:31:21.414 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 45 v 12 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-09-18T10:31:21.415 INFO:tasks.rados.rados.0.smithi160.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-09-18T10:31:21.415 INFO:tasks.rados.rados.0.smithi160.stdout:46: finishing write tid 1 to smithi16036501-46 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:46: finishing write tid 2 to smithi16036501-46 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:46: finishing write tid 3 to smithi16036501-46 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 46 v 8 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:47: finishing write tid 1 to smithi16036501-47 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:47: finishing write tid 2 to smithi16036501-47 2024-09-18T10:31:21.416 INFO:tasks.rados.rados.0.smithi160.stdout:47: finishing write tid 3 to smithi16036501-47 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 47 v 2 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:48: finishing write tid 1 to smithi16036501-48 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:48: finishing write tid 2 to smithi16036501-48 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:48: finishing write tid 3 to smithi16036501-48 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:49: finishing write tid 1 to smithi16036501-49 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:49: finishing write tid 2 to smithi16036501-49 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:48: finishing write tid 4 to smithi16036501-48 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 48 v 5 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:49: finishing write tid 3 to smithi16036501-49 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:49: finishing write tid 4 to smithi16036501-49 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 49 v 11 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-18T10:31:21.417 INFO:tasks.rados.rados.0.smithi160.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:50: finishing write tid 1 to smithi16036501-50 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:50: finishing write tid 2 to smithi16036501-50 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:50: finishing write tid 3 to smithi16036501-50 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:50: finishing write tid 4 to smithi16036501-50 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 50 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:51: finishing write tid 1 to smithi16036501-1 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:51: finishing write tid 2 to smithi16036501-1 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:51: finishing write tid 3 to smithi16036501-1 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:51: finishing write tid 4 to smithi16036501-1 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 1 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-18T10:31:21.418 INFO:tasks.rados.rados.0.smithi160.stdout:51: left oid 1 (ObjNum 50 snap 0 seq_num 50) 2024-09-18T10:31:21.419 INFO:tasks.rados.rados.0.smithi160.stdout:41: done (12 left) 2024-09-18T10:31:21.419 INFO:tasks.rados.rados.0.smithi160.stdout:42: done (11 left) 2024-09-18T10:31:21.419 INFO:tasks.rados.rados.0.smithi160.stdout:43: done (10 left) 2024-09-18T10:31:21.419 INFO:tasks.rados.rados.0.smithi160.stdout:44: done (9 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:45: done (8 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:46: done (7 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:47: done (6 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:48: done (5 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:49: done (4 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:50: done (3 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:51: done (2 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:53: done (1 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:54: rollback oid 4 current snap is 0 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:54: done (1 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:55: delete oid 34 current snap is 0 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:52: finishing write tid 1 to smithi16036501-19 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:52: finishing write tid 2 to smithi16036501-19 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:55: done (1 left) 2024-09-18T10:31:21.420 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 21 current snap is 0 2024-09-18T10:31:21.421 INFO:tasks.rados.rados.0.smithi160.stdout:56: seq_num 54 ranges {344064=540672,884736=376832} 2024-09-18T10:31:21.423 INFO:tasks.rados.rados.0.smithi160.stdout:56: writing smithi16036501-21 from 344064 to 884736 tid 1 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:56: writing smithi16036501-21 from 884736 to 1261568 tid 2 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:57: rollback oid 47 current snap is 0 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:57: done (2 left) 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:58: delete oid 11 current snap is 0 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:52: finishing write tid 3 to smithi16036501-19 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:52: finishing write tid 4 to smithi16036501-19 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 9 (ObjNum 51 snap 0 seq_num 51) dirty exists 2024-09-18T10:31:21.426 INFO:tasks.rados.rados.0.smithi160.stdout:52: left oid 19 (ObjNum 51 snap 0 seq_num 51) 2024-09-18T10:31:21.427 INFO:tasks.rados.rados.0.smithi160.stdout:56: finishing write tid 1 to smithi16036501-21 2024-09-18T10:31:21.428 INFO:tasks.rados.rados.0.smithi160.stdout:52: done (2 left) 2024-09-18T10:31:21.428 INFO:tasks.rados.rados.0.smithi160.stdout:58: done (1 left) 2024-09-18T10:31:21.428 INFO:tasks.rados.rados.0.smithi160.stdout:59: read oid 50 snap -1 2024-09-18T10:31:21.428 INFO:tasks.rados.rados.0.smithi160.stdout:59: expect (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:31:21.428 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 23 current snap is 0 2024-09-18T10:31:21.428 INFO:tasks.rados.rados.0.smithi160.stdout:60: seq_num 56 ranges {376832=573440,950272=376832} 2024-09-18T10:31:21.437 INFO:tasks.rados.rados.0.smithi160.stdout:60: writing smithi16036501-23 from 376832 to 950272 tid 1 2024-09-18T10:31:21.437 INFO:tasks.rados.rados.0.smithi160.stdout:60: writing smithi16036501-23 from 950272 to 1327104 tid 2 2024-09-18T10:31:21.437 INFO:tasks.rados.rados.0.smithi160.stdout:61: delete oid 18 current snap is 0 2024-09-18T10:31:21.437 INFO:tasks.rados.rados.0.smithi160.stdout:56: finishing write tid 2 to smithi16036501-21 2024-09-18T10:31:21.437 INFO:tasks.rados.rados.0.smithi160.stdout:56: finishing write tid 3 to smithi16036501-21 2024-09-18T10:31:21.438 INFO:tasks.rados.rados.0.smithi160.stdout:56: finishing write tid 4 to smithi16036501-21 2024-09-18T10:31:21.438 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 21 v 15 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-18T10:31:21.438 INFO:tasks.rados.rados.0.smithi160.stdout:56: left oid 21 (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:21.438 INFO:tasks.rados.rados.0.smithi160.stdout:59: expect (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:60: finishing write tid 1 to smithi16036501-23 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:60: finishing write tid 2 to smithi16036501-23 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:60: finishing write tid 3 to smithi16036501-23 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:60: finishing write tid 4 to smithi16036501-23 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 23 v 16 (ObjNum 56 snap 0 seq_num 56) dirty exists 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:60: left oid 23 (ObjNum 56 snap 0 seq_num 56) 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:56: done (3 left) 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:59: done (2 left) 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:60: done (1 left) 2024-09-18T10:31:21.459 INFO:tasks.rados.rados.0.smithi160.stdout:61: done (0 left) 2024-09-18T10:31:21.460 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 26 current snap is 0 2024-09-18T10:31:21.460 INFO:tasks.rados.rados.0.smithi160.stdout:62: seq_num 58 ranges {425984=606208,1032192=376832} 2024-09-18T10:31:21.464 INFO:tasks.rados.rados.0.smithi160.stdout:62: writing smithi16036501-26 from 425984 to 1032192 tid 1 2024-09-18T10:31:21.466 INFO:tasks.rados.rados.0.smithi160.stdout:62: writing smithi16036501-26 from 1032192 to 1409024 tid 2 2024-09-18T10:31:21.466 INFO:tasks.rados.rados.0.smithi160.stdout:63: setattr oid 37 current snap is 0 2024-09-18T10:31:21.467 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:21.464+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:21.467 INFO:tasks.rados.rados.0.smithi160.stdout:64: read oid 32 snap -1 2024-09-18T10:31:21.467 INFO:tasks.rados.rados.0.smithi160.stdout:64: expect (ObjNum 31 snap 0 seq_num 31) 2024-09-18T10:31:21.467 INFO:tasks.rados.rados.0.smithi160.stdout:65: delete oid 47 current snap is 0 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:62: finishing write tid 1 to smithi16036501-26 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:65: done (3 left) 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:66: read oid 21 snap -1 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:66: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:67: rollback oid 18 current snap is 0 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:67: done (4 left) 2024-09-18T10:31:21.470 INFO:tasks.rados.rados.0.smithi160.stdout:68: snap_create 2024-09-18T10:31:21.472 INFO:tasks.rados.rados.0.smithi160.stdout:64: expect (ObjNum 31 snap 0 seq_num 31) 2024-09-18T10:31:21.484 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.484 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.486 INFO:tasks.rados.rados.0.smithi160.stdout:62: finishing write tid 2 to smithi16036501-26 2024-09-18T10:31:21.487 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 14 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-18T10:31:21.487 INFO:tasks.rados.rados.0.smithi160.stdout:62: finishing write tid 3 to smithi16036501-26 2024-09-18T10:31:21.487 INFO:tasks.rados.rados.0.smithi160.stdout:62: finishing write tid 4 to smithi16036501-26 2024-09-18T10:31:21.487 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 26 v 15 (ObjNum 58 snap 0 seq_num 58) dirty exists 2024-09-18T10:31:21.487 INFO:tasks.rados.rados.0.smithi160.stdout:62: left oid 26 (ObjNum 58 snap 0 seq_num 58) 2024-09-18T10:31:21.487 INFO:tasks.rados.rados.0.smithi160.stdout:66: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:21.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:21.568 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:21.566+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:21.595 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.595 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.604 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:21.668 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:21.667+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:21.706 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.706 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.714 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:21.798 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:21.797+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:21.856 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:21.856 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:21.865 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:21.906 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:21.905+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:21.971 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:21.970+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:22.007 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.007 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.015 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:22.072 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:22.071+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:22.158 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.158 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.166 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:22.210 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:22.209+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:22.265 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:31:22.265 INFO:tasks.rados.rados.0.smithi160.stdout:62: done (4 left) 2024-09-18T10:31:22.265 INFO:tasks.rados.rados.0.smithi160.stdout:63: done (3 left) 2024-09-18T10:31:22.265 INFO:tasks.rados.rados.0.smithi160.stdout:64: done (2 left) 2024-09-18T10:31:22.266 INFO:tasks.rados.rados.0.smithi160.stdout:66: done (1 left) 2024-09-18T10:31:22.266 INFO:tasks.rados.rados.0.smithi160.stdout:68: done (0 left) 2024-09-18T10:31:22.266 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 25 current snap is 1 2024-09-18T10:31:22.266 INFO:tasks.rados.rados.0.smithi160.stdout:69: seq_num 60 ranges {409600=638976,1048576=376832} 2024-09-18T10:31:22.268 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.269 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.270 INFO:tasks.rados.rados.0.smithi160.stdout:69: writing smithi16036501-25 from 409600 to 1048576 tid 1 2024-09-18T10:31:22.272 INFO:tasks.rados.rados.0.smithi160.stdout:69: writing smithi16036501-25 from 1048576 to 1425408 tid 2 2024-09-18T10:31:22.272 INFO:tasks.rados.rados.0.smithi160.stdout:70: snap_create 2024-09-18T10:31:22.273 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:22.272+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:22.277 INFO:tasks.rados.rados.0.smithi160.stdout:69: finishing write tid 1 to smithi16036501-25 2024-09-18T10:31:22.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:22.282 INFO:tasks.rados.rados.0.smithi160.stdout:69: finishing write tid 2 to smithi16036501-25 2024-09-18T10:31:22.282 INFO:tasks.rados.rados.0.smithi160.stdout:69: finishing write tid 3 to smithi16036501-25 2024-09-18T10:31:22.282 INFO:tasks.rados.rados.0.smithi160.stdout:69: finishing write tid 4 to smithi16036501-25 2024-09-18T10:31:22.282 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 25 v 13 (ObjNum 60 snap 1 seq_num 60) dirty exists 2024-09-18T10:31:22.282 INFO:tasks.rados.rados.0.smithi160.stdout:69: left oid 25 (ObjNum 60 snap 1 seq_num 60) 2024-09-18T10:31:22.374 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:22.372+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:22.422 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.422 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:22.475 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:22.473+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:22.532 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.533 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.541 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:22.585 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:22.584+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:22.643 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.643 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:22.677 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:22.675+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:22.779 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:22.777+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:22.795 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.795 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:22.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:22.880 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:22.879+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:22.913 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:22.913 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:22.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:22.929 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:22.929 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:22.946 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:22.946 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:22.961 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:22.962 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:22.978 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:22.980 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:22.979+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:22.993 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:22.993 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:23.009 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:23.020 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.020 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:23.020 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:23.020 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:23.020 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:23.025 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:23.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:23.041 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:23.041 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:23.056 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:23.057 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:23.072 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:23.072 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:23.082 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:23.080+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:23.088 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:23.088 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:23.119 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:23.126 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2024-09-18T10:31:23.127 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:23.151 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:23.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:23.150+0000 7efe94cfa640 0 -- 172.21.15.63:0/1623957911 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7efe90195a70 msgr2=0x7efe90197e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:23.182 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:23.181+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:23.233 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.234 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:23.234 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:23.234 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:69: done (1 left) 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:70: done (0 left) 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:71: setattr oid 13 current snap is 2 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:72: read oid 20 snap 0 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:72: expect (ObjNum 19 snap 0 seq_num 19) 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 42 current snap is 2 2024-09-18T10:31:23.269 INFO:tasks.rados.rados.0.smithi160.stdout:73: seq_num 61 ranges {704512=655360,1359872=376832} 2024-09-18T10:31:23.276 INFO:tasks.rados.rados.0.smithi160.stdout:73: writing smithi16036501-42 from 704512 to 1359872 tid 1 2024-09-18T10:31:23.278 INFO:tasks.rados.rados.0.smithi160.stdout:73: writing smithi16036501-42 from 1359872 to 1736704 tid 2 2024-09-18T10:31:23.278 INFO:tasks.rados.rados.0.smithi160.stdout:74: snap_create 2024-09-18T10:31:23.278 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 13 v 17 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-18T10:31:23.278 INFO:tasks.rados.rados.0.smithi160.stdout:72: expect (ObjNum 19 snap 0 seq_num 19) 2024-09-18T10:31:23.283 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:23.282+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:23.288 INFO:tasks.rados.rados.0.smithi160.stdout:73: finishing write tid 1 to smithi16036501-42 2024-09-18T10:31:23.288 INFO:tasks.rados.rados.0.smithi160.stdout:73: finishing write tid 2 to smithi16036501-42 2024-09-18T10:31:23.289 INFO:tasks.rados.rados.0.smithi160.stdout:73: finishing write tid 3 to smithi16036501-42 2024-09-18T10:31:23.289 INFO:tasks.rados.rados.0.smithi160.stdout:73: finishing write tid 4 to smithi16036501-42 2024-09-18T10:31:23.289 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 42 v 20 (ObjNum 61 snap 2 seq_num 61) dirty exists 2024-09-18T10:31:23.289 INFO:tasks.rados.rados.0.smithi160.stdout:73: left oid 42 (ObjNum 61 snap 2 seq_num 61) 2024-09-18T10:31:23.368 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:23.380 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:23.380 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.385 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:23.383+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:23.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:23.485 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4356.0:1 2.3 e27/26 2:c4c92e5a:::rbd_trash:head v 27'1, mlcod=0'0)", 2024-09-18T10:31:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.181558+0000", 2024-09-18T10:31:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.302658666999999, 2024-09-18T10:31:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049459299999999999, 2024-09-18T10:31:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181558+0000", 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181558+0000", 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181558+0000", 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181563+0000", 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4489999999999998e-06 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181573+0000", 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7589999999999992e-06 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181581+0000", 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9289999999999998e-06 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181613+0000", 2024-09-18T10:31:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.222e-05 2024-09-18T10:31:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.181636+0000", 2024-09-18T10:31:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2439999999999999e-05 2024-09-18T10:31:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.182009+0000", 2024-09-18T10:31:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037357299999999998 2024-09-18T10:31:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.182053+0000", 2024-09-18T10:31:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3775e-05 2024-09-18T10:31:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 38/33 ECSubWrite(tid=27, reqid=client.4589.0:195, at_version=38'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-18T10:31:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.21315587799999999, 2024-09-18T10:31:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001667527, 2024-09-18T10:31:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271143+0000", 2024-09-18T10:31:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2144000000000005e-05 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271160+0000", 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7187e-05 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271167+0000", 2024-09-18T10:31:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3830000000000003e-06 2024-09-18T10:31:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271224+0000", 2024-09-18T10:31:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6783999999999997e-05 2024-09-18T10:31:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271236+0000", 2024-09-18T10:31:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1496e-05 2024-09-18T10:31:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272705+0000", 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001469637 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272729+0000", 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3264e-05 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 38/33 ECSubWrite(tid=28, reqid=client.4589.0:195, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.273563+0000", 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.21065418399999999, 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017263059999999999, 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273563+0000", 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273563+0000", 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273562+0000", 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273571+0000", 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-06 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273581+0000", 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0886e-05 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273586+0000", 2024-09-18T10:31:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5249999999999999e-06 2024-09-18T10:31:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273628+0000", 2024-09-18T10:31:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2497000000000003e-05 2024-09-18T10:31:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273638+0000", 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5810000000000003e-06 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275264+0000", 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016264090000000001 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275289+0000", 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4678999999999999e-05 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.509 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.510 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:23.484+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:23.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:23.587 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:23.586+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:23.609 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.609 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:23.609 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:23.610 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:23.687 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:23.686+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:23.714 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.714 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:23.715 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:23.715 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:23.715 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:23.788 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:23.787+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:23.860 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:23.860 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 38/33 ECSubWrite(tid=27, reqid=client.4589.0:195, at_version=38'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.271092+0000", 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.58875824700000001, 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013050329999999999, 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:23.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271092+0000", 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271092+0000", 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271091+0000", 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271234+0000", 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:23.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271249+0000", 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5441e-05 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271283+0000", 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3642000000000001e-05 2024-09-18T10:31:23.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271334+0000", 2024-09-18T10:31:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1518999999999999e-05 2024-09-18T10:31:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271344+0000", 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5130000000000002e-06 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272371+0000", 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001027476 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272397+0000", 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5530000000000001e-05 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 38/33 ECSubWrite(tid=28, reqid=client.4589.0:195, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.58630167700000002, 2024-09-18T10:31:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00174631, 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273557+0000", 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7579999999999998e-06 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273565+0000", 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7180000000000002e-06 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273572+0000", 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9360000000000002e-06 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273604+0000", 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1489000000000003e-05 2024-09-18T10:31:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273612+0000", 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0579999999999998e-06 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275276+0000", 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001663812 2024-09-18T10:31:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275295+0000", 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9181000000000002e-05 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:23.872 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:23.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:23.917 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:23.916+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:23.972 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:24.038 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:24.038 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:24.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:24.040 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:24.039+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:24.140 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:24.139+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:24.177 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:24.178 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:24.178 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:24.178 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:24.178 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:24.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:24.241 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:24.240+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:71: done (3 left) 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:72: done (2 left) 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:73: done (1 left) 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:74: done (0 left) 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:75: read oid 19 snap 0 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:75: expect (ObjNum 51 snap 0 seq_num 51) 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 13 current snap is 3 2024-09-18T10:31:24.270 INFO:tasks.rados.rados.0.smithi160.stdout:76: seq_num 62 ranges {212992=671744,884736=376832} 2024-09-18T10:31:24.274 INFO:tasks.rados.rados.0.smithi160.stdout:76: writing smithi16036501-13 from 212992 to 884736 tid 1 2024-09-18T10:31:24.277 INFO:tasks.rados.rados.0.smithi160.stdout:76: writing smithi16036501-13 from 884736 to 1261568 tid 2 2024-09-18T10:31:24.277 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 16 current snap is 3 2024-09-18T10:31:24.277 INFO:tasks.rados.rados.0.smithi160.stdout:77: seq_num 63 ranges {262144=688128,950272=376832} 2024-09-18T10:31:24.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:31:24.282 INFO:tasks.rados.rados.0.smithi160.stdout:77: writing smithi16036501-16 from 262144 to 950272 tid 1 2024-09-18T10:31:24.285 INFO:tasks.rados.rados.0.smithi160.stdout:77: writing smithi16036501-16 from 950272 to 1327104 tid 2 2024-09-18T10:31:24.285 INFO:tasks.rados.rados.0.smithi160.stdout:78: delete oid 27 current snap is 3 2024-09-18T10:31:24.285 INFO:tasks.rados.rados.0.smithi160.stdout:75: expect (ObjNum 51 snap 0 seq_num 51) 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:24.293 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.106172252, 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.349076098, 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185093+0000", 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999952 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185102+0000", 2024-09-18T10:31:24.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-09-18T10:31:24.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185111+0000", 2024-09-18T10:31:24.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4130000000000006e-06 2024-09-18T10:31:24.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185116+0000", 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0080000000000002e-06 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185151+0000", 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5216000000000003e-05 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185156+0000", 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5090000000000001e-06 2024-09-18T10:31:24.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534040+0000", 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.34888328099999999 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534174+0000", 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134129 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.534441+0000", 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.756829445000001, 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116016, 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:24.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3 2024-09-18T10:31:24.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534441+0000", 2024-09-18T10:31:24.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534441+0000", 2024-09-18T10:31:24.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534440+0000", 2024-09-18T10:31:24.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534447+0000", 2024-09-18T10:31:24.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3100000000000003e-06 2024-09-18T10:31:24.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534457+0000", 2024-09-18T10:31:24.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0132000000000001e-05 2024-09-18T10:31:24.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534465+0000", 2024-09-18T10:31:24.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2849999999999995e-06 2024-09-18T10:31:24.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534496+0000", 2024-09-18T10:31:24.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0673000000000003e-05 2024-09-18T10:31:24.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534557+0000", 2024-09-18T10:31:24.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0637999999999998e-05 2024-09-18T10:31:24.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:06.178152+0000", 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.113118433, 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034506150000000002, 2024-09-18T10:31:24.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.310 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:24.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 5 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178152+0000", 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178152+0000", 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178149+0000", 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178163+0000", 2024-09-18T10:31:24.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4081e-05 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178184+0000", 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0324999999999999e-05 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178191+0000", 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3749999999999997e-06 2024-09-18T10:31:24.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178244+0000", 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2898000000000001e-05 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178249+0000", 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0010000000000001e-06 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.179764+0000", 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015156460000000001 2024-09-18T10:31:24.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.179860+0000", 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5420999999999993e-05 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.179973+0000", 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112738 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:31:24.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.180839+0000", 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086666599999999999 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181519+0000", 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067923799999999998 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181560+0000", 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1012e-05 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181602+0000", 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2707000000000003e-05 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4356.0:5 2.2 e27/26 ondisk, result = 0)", 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:06.181409+0000", 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.109861486, 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000204348, 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:24.317 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181409+0000", 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181409+0000", 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181407+0000", 2024-09-18T10:31:24.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181414+0000", 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.105e-06 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181427+0000", 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3217999999999999e-05 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181433+0000", 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7279999999999998e-06 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181507+0000", 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3715999999999997e-05 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181515+0000", 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5020000000000003e-06 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181613+0000", 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8189999999999993e-05 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.106258189999998, 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010537852, 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185009+0000", 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185021+0000", 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024e-05 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185062+0000", 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0363e-05 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185072+0000", 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0712e-05 2024-09-18T10:31:24.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185133+0000", 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0458999999999998e-05 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185140+0000", 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1720000000000001e-06 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190251+0000", 2024-09-18T10:31:24.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051104840000000002 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190319+0000", 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8640999999999996e-05 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190422+0000", 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102576 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.191693+0000", 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012707980000000001 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195487+0000", 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003794651 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195521+0000", 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3760999999999997e-05 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195550+0000", 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742e-05 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpRead(3.1s1 38/33 ECSubRead(tid=74, to_read={3:8a576e44:::smithi16036501-20:head=0,81920,0}, subchunks={3:8a576e44:::smithi16036501-20:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.270621+0000", 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0206486420000001, 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00052251700000000001, 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.328 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270621+0000", 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270621+0000", 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270621+0000", 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270629+0000", 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5809999999999999e-06 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270640+0000", 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.149e-05 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270647+0000", 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8600000000000004e-06 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270702+0000", 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4867000000000002e-05 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271144+0000", 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044186200000000001 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpRead(3.1s1 38/33 ECSubRead(tid=75, to_read={3:8a576e44:::smithi16036501-20:head=0,81920,0}, subchunks={3:8a576e44:::smithi16036501-20:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.270861+0000", 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0204092570000001, 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081413500000000001, 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270861+0000", 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270861+0000", 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270860+0000", 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270867+0000", 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9469999999999997e-06 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270877+0000", 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7289999999999995e-06 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.270881+0000", 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0849999999999999e-06 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271170+0000", 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000289232 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271675+0000", 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050457900000000001 2024-09-18T10:31:24.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpRead(3.1s1 38/33 ECSubRead(tid=76, to_read={3:8a576e44:::smithi16036501-20:head=0,81920,0}, subchunks={3:8a576e44:::smithi16036501-20:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.271977+0000", 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0192926360000001, 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018357599999999999, 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271977+0000", 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271977+0000", 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271977+0000", 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271984+0000", 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4080000000000001e-06 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271997+0000", 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2444e-05 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272004+0000", 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.277e-06 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272063+0000", 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8730000000000002e-05 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272161+0000", 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8315999999999999e-05 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:199 3.fs0 3:f4795e34:::smithi16036501-42:head [append 0~655360] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0153888200000001, 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069400019999999998, 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 199 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275880+0000", 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276765+0000", 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088549699999999996 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276778+0000", 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2252999999999999e-05 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276782+0000", 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2810000000000002e-06 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276813+0000", 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1058e-05 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276874+0000", 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1088999999999997e-05 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.277608+0000", 2024-09-18T10:31:24.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073422699999999995 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280017+0000", 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024085579999999999 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282781+0000", 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027636050000000001 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282821+0000", 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0683999999999999e-05 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:200 3.fs0 3:f4795e34:::smithi16036501-42:head [append 0~376832] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0132460409999999, 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076441959999999998, 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 200 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278023+0000", 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278670+0000", 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064669399999999996 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278679+0000", 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4809999999999995e-06 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278683+0000", 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7900000000000001e-06 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278710+0000", 2024-09-18T10:31:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7151000000000001e-05 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278759+0000", 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8618000000000001e-05 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279167+0000", 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040784699999999997 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280125+0000", 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095786999999999999 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285637+0000", 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055121420000000003 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285668+0000", 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1341999999999999e-05 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:201 3.fs0 3:f4795e34:::smithi16036501-42:head [setxattr _header (56) in=7b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0125807, 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071686570000000002, 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 201 2024-09-18T10:31:24.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278692+0000", 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9440000000000001e-06 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278697+0000", 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6980000000000003e-06 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278700+0000", 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279543+0000", 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084349999999999996 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279615+0000", 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1477999999999996e-05 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279853+0000", 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238106 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280169+0000", 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031569500000000001 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285808+0000", 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056395229999999996 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285858+0000", 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9799000000000002e-05 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:202 3.fs0 3:f4795e34:::smithi16036501-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.012556926, 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081974649999999993, 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 202 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:24.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278715+0000", 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3609999999999999e-06 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278722+0000", 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5520000000000001e-06 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278725+0000", 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-06 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280064+0000", 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013385389999999999 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280120+0000", 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5856999999999997e-05 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286097+0000", 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059775230000000002 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286178+0000", 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0519999999999995e-05 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286911+0000", 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073268499999999996 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWriteReply(3.fs0 38/33 ECSubWriteReply(tid=54, last_complete=38'18, committed=1, applied=1))", 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.279217+0000", 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0120526990000001, 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080047099999999997, 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.361 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279217+0000", 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279217+0000", 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279216+0000", 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279222+0000", 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.288e-06 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279234+0000", 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1885000000000001e-05 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279241+0000", 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3289999999999996e-06 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280005+0000", 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000764019 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280018+0000", 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWriteReply(3.fs0 38/33 ECSubWriteReply(tid=54, last_complete=38'18, committed=1, applied=1))", 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.279641+0000", 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0116291820000001, 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041099499999999999, 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279641+0000", 2024-09-18T10:31:24.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279641+0000", 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279640+0000", 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279644+0000", 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2329999999999998e-06 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279655+0000", 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1623999999999999e-05 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279660+0000", 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.515e-06 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280045+0000", 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000385459 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280052+0000", 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7309999999999996e-06 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWriteReply(3.fs0 38/33 ECSubWriteReply(tid=54, last_complete=38'18, committed=1, applied=1))", 2024-09-18T10:31:24.368 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.282715+0000", 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.008555501, 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115673, 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282715+0000", 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282715+0000", 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282714+0000", 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282717+0000", 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6850000000000001e-06 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282722+0000", 2024-09-18T10:31:24.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9960000000000001e-06 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282724+0000", 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.345e-06 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282742+0000", 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8102999999999999e-05 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282830+0000", 2024-09-18T10:31:24.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7930999999999995e-05 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWriteReply(3.fs0 38/33 ECSubWriteReply(tid=56, last_complete=38'20, committed=1, applied=1))", 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.285731+0000", 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0055392970000001, 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000324371, 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285731+0000", 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285731+0000", 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285730+0000", 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285733+0000", 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6900000000000001e-06 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285739+0000", 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6529999999999999e-06 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285743+0000", 2024-09-18T10:31:24.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6199999999999998e-06 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285769+0000", 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5389e-05 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286055+0000", 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028639300000000002 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpRead(3.fs0 38/33 ECSubRead(tid=58, to_read={3:f4795e34:::smithi16036501-42:head=0,4096,0}, subchunks={3:f4795e34:::smithi16036501-42:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.286361+0000", 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0049093760000001, 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116877, 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286361+0000", 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286361+0000", 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286361+0000", 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286361+0000", 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286379+0000", 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8134999999999998e-05 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286387+0000", 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5949999999999999e-06 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286427+0000", 2024-09-18T10:31:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9508000000000002e-05 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286478+0000", 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0639000000000001e-05 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpReadReply(3.fs0 38/33 ECSubReadReply(tid=58, attrs_read=0))", 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.286656+0000", 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0046136919999999, 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121088, 2024-09-18T10:31:24.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286656+0000", 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286656+0000", 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286655+0000", 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286666+0000", 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0390999999999999e-05 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286675+0000", 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6290000000000005e-06 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286680+0000", 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4320000000000001e-06 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286759+0000", 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9344999999999993e-05 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286777+0000", 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8161000000000001e-05 2024-09-18T10:31:24.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpReadReply(3.fs0 38/33 ECSubReadReply(tid=58, attrs_read=0))", 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.286683+0000", 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.00458702, 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023380100000000001, 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286683+0000", 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286683+0000", 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286683+0000", 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286688+0000", 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1580000000000004e-06 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286693+0000", 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1970000000000004e-06 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286695+0000", 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.221e-06 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286828+0000", 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132595 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286917+0000", 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8819999999999993e-05 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWriteReply(3.fs0 38/33 ECSubWriteReply(tid=57, last_complete=38'20, committed=1, applied=1))", 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.286697+0000", 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.004572636, 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011660299999999999, 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286697+0000", 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286697+0000", 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286697+0000", 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286700+0000", 2024-09-18T10:31:24.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8899999999999999e-06 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286705+0000", 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4659999999999998e-06 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286711+0000", 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6829999999999996e-06 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286804+0000", 2024-09-18T10:31:24.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2472999999999994e-05 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286814+0000", 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0421999999999999e-05 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:24.390 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:24.392 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:24.393 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:24.391+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:24.393 INFO:tasks.rados.rados.0.smithi160.stdout:76: finishing write tid 1 to smithi16036501-13 2024-09-18T10:31:24.393 INFO:tasks.rados.rados.0.smithi160.stdout:76: finishing write tid 2 to smithi16036501-13 2024-09-18T10:31:24.393 INFO:tasks.rados.rados.0.smithi160.stdout:76: finishing write tid 3 to smithi16036501-13 2024-09-18T10:31:24.393 INFO:tasks.rados.rados.0.smithi160.stdout:76: finishing write tid 4 to smithi16036501-13 2024-09-18T10:31:24.393 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 13 v 21 (ObjNum 62 snap 3 seq_num 62) dirty exists 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:76: left oid 13 (ObjNum 62 snap 3 seq_num 62) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:77: finishing write tid 1 to smithi16036501-16 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:77: finishing write tid 2 to smithi16036501-16 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:77: finishing write tid 3 to smithi16036501-16 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:77: finishing write tid 4 to smithi16036501-16 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 18 (ObjNum 63 snap 3 seq_num 63) dirty exists 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:77: left oid 16 (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:75: done (3 left) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:76: done (2 left) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:77: done (1 left) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:78: done (0 left) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:79: read oid 33 snap -1 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:79: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-18T10:31:24.394 INFO:tasks.rados.rados.0.smithi160.stdout:80: rollback oid 35 current snap is 3 2024-09-18T10:31:24.395 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 35 to 2 2024-09-18T10:31:24.395 INFO:tasks.rados.rados.0.smithi160.stdout:81: rollback oid 6 current snap is 3 2024-09-18T10:31:24.395 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 6 to 0 2024-09-18T10:31:24.395 INFO:tasks.rados.rados.0.smithi160.stdout:82: snap_remove snap 1 2024-09-18T10:31:24.492 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:24.491+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:24.498 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:24.498 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:24.499 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:24.499 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:24.507 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:24.593 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:24.591+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:24.604 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:24.604 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:24.604 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:24.604 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:24.604 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:24.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:24.694 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:24.693+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/33 ECSubWrite(tid=27, reqid=client.4589.0:195, at_version=38'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.270956+0000", 2024-09-18T10:31:24.752 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.479454402, 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001692034, 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270956+0000", 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270956+0000", 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270955+0000", 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271028+0000", 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2347000000000004e-05 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271041+0000", 2024-09-18T10:31:24.754 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2731000000000001e-05 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271047+0000", 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.4829999999999996e-06 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271109+0000", 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2014000000000006e-05 2024-09-18T10:31:24.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271121+0000", 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1785e-05 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.272614+0000", 2024-09-18T10:31:24.756 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0014934620000000001 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.272648+0000", 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3528999999999997e-05 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.757 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/33 ECSubWrite(tid=28, reqid=client.4589.0:195, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.273523+0000", 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.476887509, 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001749703, 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273523+0000", 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.758 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273523+0000", 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273522+0000", 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.759 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273533+0000", 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1439e-05 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4773000000000001e-05 2024-09-18T10:31:24.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.761 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.761 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.761 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273555+0000", 2024-09-18T10:31:24.761 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1099999999999997e-06 2024-09-18T10:31:24.761 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.761 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.762 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.762 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273614+0000", 2024-09-18T10:31:24.762 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8891999999999998e-05 2024-09-18T10:31:24.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.762 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.763 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.763 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.273625+0000", 2024-09-18T10:31:24.763 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1358999999999999e-05 2024-09-18T10:31:24.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.763 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.763 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.764 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.275246+0000", 2024-09-18T10:31:24.764 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016207400000000001 2024-09-18T10:31:24.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.764 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.764 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.765 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.275272+0000", 2024-09-18T10:31:24.765 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6325e-05 2024-09-18T10:31:24.765 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.765 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.765 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/33 ECSubWrite(tid=54, reqid=client.4589.0:199, at_version=38'18, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.277629+0000", 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.4727810749999999, 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001928138, 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.766 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.277629+0000", 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.277629+0000", 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.767 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.277629+0000", 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.278287+0000", 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00065799900000000004 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.278306+0000", 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9230000000000001e-05 2024-09-18T10:31:24.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.278313+0000", 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2479999999999999e-06 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.278364+0000", 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0705000000000003e-05 2024-09-18T10:31:24.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.278371+0000", 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.421e-06 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279492+0000", 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011211999999999999 2024-09-18T10:31:24.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279557+0000", 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5455000000000003e-05 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/33 ECSubWrite(tid=55, reqid=client.4589.0:200, at_version=38'19, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:24.771 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.279199+0000", 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.4712108129999999, 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012542300000000001, 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279199+0000", 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279199+0000", 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279198+0000", 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.773 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.774 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.774 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279470+0000", 2024-09-18T10:31:24.774 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000272024 2024-09-18T10:31:24.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.774 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.774 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.775 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279489+0000", 2024-09-18T10:31:24.775 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8462999999999999e-05 2024-09-18T10:31:24.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.775 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.775 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.775 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279498+0000", 2024-09-18T10:31:24.776 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1540000000000008e-06 2024-09-18T10:31:24.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.776 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.776 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.776 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279601+0000", 2024-09-18T10:31:24.777 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000102877 2024-09-18T10:31:24.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.777 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.777 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.777 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279611+0000", 2024-09-18T10:31:24.777 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0643e-05 2024-09-18T10:31:24.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.778 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.778 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.778 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.280430+0000", 2024-09-18T10:31:24.778 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00081879700000000001 2024-09-18T10:31:24.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.280454+0000", 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3320999999999999e-05 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/33 ECSubWrite(tid=56, reqid=client.4589.0:201, at_version=38'20, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.279850+0000", 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.4705599739999999, 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.002837109, 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.780 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279850+0000", 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279850+0000", 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279849+0000", 2024-09-18T10:31:24.781 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279876+0000", 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6452999999999999e-05 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279891+0000", 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5047e-05 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.279899+0000", 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7589999999999997e-06 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.280019+0000", 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00012047 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.280035+0000", 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5790999999999998e-05 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.282658+0000", 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00262276 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.282687+0000", 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9624999999999998e-05 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.784 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/33 ECSubWrite(tid=57, reqid=client.4589.0:201, at_version=0'0, trim_to=0'0, roll_forward_to=38'20))", 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.285988+0000", 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.464422291, 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056403900000000001, 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.285988+0000", 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.285988+0000", 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.285987+0000", 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.285999+0000", 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.24e-05 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.286017+0000", 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7280999999999999e-05 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.286024+0000", 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.075e-06 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.286075+0000", 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0961999999999998e-05 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.788 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.286083+0000", 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.6270000000000006e-06 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.286531+0000", 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00044742799999999999 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.286552+0000", 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1087999999999999e-05 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.47069770500000002, 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038939790000000001, 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.790 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:24.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280263+0000", 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00055099599999999999 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280278+0000", 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5228999999999999e-05 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280288+0000", 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5100000000000004e-06 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280395+0000", 2024-09-18T10:31:24.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000107521 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280408+0000", 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2123999999999999e-05 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.283584+0000", 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003176089 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.283606+0000", 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2775000000000001e-05 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=30, reqid=client.4589.0:208, at_version=39'20, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.281322+0000", 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.46908782100000002, 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.002302213, 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281322+0000", 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281322+0000", 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281321+0000", 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281557+0000", 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000235646 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281570+0000", 2024-09-18T10:31:24.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3529e-05 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281578+0000", 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2779999999999996e-06 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281816+0000", 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00023822700000000001 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.281826+0000", 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0331e-05 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.283612+0000", 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001786342 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.283625+0000", 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2084e-05 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.799 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=31, reqid=client.4589.0:209, at_version=39'21, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.284034+0000", 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.46637624, 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021224500000000001, 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284034+0000", 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284034+0000", 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284033+0000", 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284052+0000", 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8808e-05 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284064+0000", 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1849e-05 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284069+0000", 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3190000000000002e-06 2024-09-18T10:31:24.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284119+0000", 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9950000000000001e-05 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.284125+0000", 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7819999999999999e-06 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286107+0000", 2024-09-18T10:31:24.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0019825849999999998 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286156+0000", 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9054999999999997e-05 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=32, reqid=client.4589.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.287387+0000", 2024-09-18T10:31:24.804 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.46302341400000002, 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00067929399999999999, 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287387+0000", 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287387+0000", 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287386+0000", 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287399+0000", 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3326000000000001e-05 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287417+0000", 2024-09-18T10:31:24.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8312999999999999e-05 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287424+0000", 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1080000000000004e-06 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287472+0000", 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7718e-05 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287482+0000", 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4320000000000005e-06 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288041+0000", 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00055907600000000004 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288066+0000", 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5466e-05 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.808 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpRead(3.6s3 39/33 ECSubRead(tid=33, to_read={3:61b75516:::smithi16036501-13:head=0,4096,0}, subchunks={3:61b75516:::smithi16036501-13:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.288477+0000", 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.461933541, 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00023289299999999999, 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288477+0000", 2024-09-18T10:31:24.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288477+0000", 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288476+0000", 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288487+0000", 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1627999999999999e-05 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288507+0000", 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9329000000000001e-05 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288515+0000", 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4989999999999994e-06 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288600+0000", 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4262000000000001e-05 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288710+0000", 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000109994 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=34, reqid=client.4589.0:222, at_version=39'23, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.322807+0000", 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.42760300200000001, 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011151869999999999, 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322807+0000", 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322807+0000", 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322806+0000", 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322829+0000", 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3102999999999999e-05 2024-09-18T10:31:24.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322844+0000", 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.413e-05 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322850+0000", 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9160000000000004e-06 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322895+0000", 2024-09-18T10:31:24.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4878e-05 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.322907+0000", 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1251e-05 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.323886+0000", 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00097975100000000006 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.323922+0000", 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6001999999999999e-05 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=35, reqid=client.4589.0:223, at_version=39'24, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.323986+0000", 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.426423781, 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00074106499999999995, 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.817 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.323986+0000", 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.323986+0000", 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.323986+0000", 2024-09-18T10:31:24.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324007+0000", 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1758000000000001e-05 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324020+0000", 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.305e-05 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324029+0000", 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2130000000000008e-06 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324076+0000", 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7409e-05 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324085+0000", 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.8300000000000002e-06 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324702+0000", 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00061764100000000005 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324727+0000", 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5021e-05 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.821 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=36, reqid=client.4589.0:224, at_version=39'25, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.324806+0000", 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.425604239, 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00077990000000000004, 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324806+0000", 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324806+0000", 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324805+0000", 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324824+0000", 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9111e-05 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324839+0000", 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4741e-05 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324846+0000", 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8909999999999998e-06 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324910+0000", 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.4016000000000005e-05 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.324918+0000", 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9920000000000007e-06 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.325563+0000", 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00064478799999999998 2024-09-18T10:31:24.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.325586+0000", 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3110999999999999e-05 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=37, reqid=client.4589.0:224, at_version=0'0, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.329762+0000", 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.42064862800000002, 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001589126, 2024-09-18T10:31:24.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329762+0000", 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329762+0000", 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329761+0000", 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329774+0000", 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2884000000000001e-05 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329787+0000", 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3584000000000001e-05 2024-09-18T10:31:24.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329796+0000", 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5990000000000002e-06 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329847+0000", 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0890000000000002e-05 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.329856+0000", 2024-09-18T10:31:24.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7569999999999999e-06 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.331325+0000", 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001469127 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.331351+0000", 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5205e-05 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:24.830 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:24.831 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:24.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:24.833 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:24.831+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:24.930 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:24.930 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:24.930 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:24.930 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:24.933 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:24.932+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:24.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:25.034 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:25.033+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:25.035 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:25.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:25.036 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:25.036 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:25.036 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:25.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:25.134 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:25.134+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 23.079081801000001, 2024-09-18T10:31:25.142 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76442072000000005, 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060653+0000", 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060661+0000", 2024-09-18T10:31:25.144 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4030000000000007e-06 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060672+0000", 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060691+0000", 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8553e-05 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.145 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060740+0000", 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060747+0000", 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1399999999999997e-06 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.823811+0000", 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76306395100000002 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824007+0000", 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000196737 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824158+0000", 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000150913 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824701+0000", 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054279800000000004 2024-09-18T10:31:25.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825007+0000", 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030596600000000002 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825044+0000", 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6853000000000001e-05 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825075+0000", 2024-09-18T10:31:25.148 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1102000000000001e-05 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.144289915000002, 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089361909999999996, 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.149 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 47 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:25.150 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995550+0000", 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000104314 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.151 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995559+0000", 2024-09-18T10:31:25.152 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7069999999999998e-06 2024-09-18T10:31:25.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.152 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995568+0000", 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1479999999999995e-06 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999298+0000", 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037306729999999999 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999379+0000", 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0304999999999998e-05 2024-09-18T10:31:25.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999486+0000", 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010773299999999999 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001630+0000", 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021436200000000002 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004321+0000", 2024-09-18T10:31:25.154 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0026907049999999998 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004355+0000", 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4591000000000001e-05 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004382+0000", 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6869999999999999e-05 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.144159760000001, 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089031370000000002, 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 48 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.156 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.157 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995580+0000", 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.532e-06 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995586+0000", 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8989999999999998e-06 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995590+0000", 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9099999999999998e-06 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999825+0000", 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042355350000000003 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999877+0000", 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1273999999999997e-05 2024-09-18T10:31:25.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999957+0000", 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0098000000000005e-05 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001636+0000", 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016796300000000001 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.160 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004425+0000", 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0027888000000000001 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004456+0000", 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0681e-05 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004479+0000", 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3405999999999999e-05 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.161 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.144140654000001, 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089699740000000003, 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 49 2024-09-18T10:31:25.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.163 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995598+0000", 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.495e-06 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995604+0000", 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4160000000000003e-06 2024-09-18T10:31:25.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995607+0000", 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.439e-06 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000235+0000", 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046279570000000003 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000284+0000", 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8316000000000003e-05 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000364+0000", 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0117999999999994e-05 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002075+0000", 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001711064 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.166 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004511+0000", 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024360699999999998 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004542+0000", 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0998999999999999e-05 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004565+0000", 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3458000000000001e-05 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.167 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.144123402999998, 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011464667, 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 50 2024-09-18T10:31:25.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.169 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995612+0000", 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995711+0000", 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8493999999999996e-05 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995719+0000", 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4160000000000004e-06 2024-09-18T10:31:25.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995724+0000", 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000646+0000", 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049220560000000002 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000740+0000", 2024-09-18T10:31:25.171 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4660999999999994e-05 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000883+0000", 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00014210199999999999 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002077+0000", 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011947150000000001 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.172 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007015+0000", 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049376560000000003 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007053+0000", 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8469e-05 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007077+0000", 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3876999999999999e-05 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.173 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.144004973000001, 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011450287999999999, 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 51 2024-09-18T10:31:25.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.175 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995730+0000", 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995735+0000", 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.938e-06 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995741+0000", 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.176 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995744+0000", 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2729999999999998e-06 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001284+0000", 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00553982 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001354+0000", 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9439999999999999e-05 2024-09-18T10:31:25.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001433+0000", 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9839000000000006e-05 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002242+0000", 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080809000000000002 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007122+0000", 2024-09-18T10:31:25.178 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004880428 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007150+0000", 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8309999999999998e-05 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007181+0000", 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1059000000000002e-05 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.179 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.143986571999999, 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011502327, 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 52 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.180 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.181 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995754+0000", 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1610000000000002e-06 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995760+0000", 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.182 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995764+0000", 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6739999999999999e-06 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001659+0000", 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058952459999999998 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001742+0000", 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2378000000000003e-05 2024-09-18T10:31:25.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001835+0000", 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3710999999999998e-05 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002405+0000", 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056997199999999997 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.184 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007206+0000", 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048005959999999999 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007231+0000", 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5449999999999999e-05 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007252+0000", 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0319e-05 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.185 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.009877062000001, 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010184168, 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 71 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.186 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:25.187 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129861+0000", 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1019999999999999e-06 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129864+0000", 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.898e-06 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.188 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129866+0000", 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0339999999999999e-06 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133579+0000", 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037133029999999998 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133627+0000", 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7700000000000001e-05 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.189 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133711+0000", 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3752999999999996e-05 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136265+0000", 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025542759999999999 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.139993+0000", 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003728543 2024-09-18T10:31:25.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140023+0000", 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0103999999999998e-05 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140043+0000", 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.191 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.009867686, 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286735, 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 72 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.192 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:25.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129937+0000", 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8833999999999999e-05 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129943+0000", 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6710000000000004e-06 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129946+0000", 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2480000000000001e-06 2024-09-18T10:31:25.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133930+0000", 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039838319999999997 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133979+0000", 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9802999999999997e-05 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134057+0000", 2024-09-18T10:31:25.195 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7226999999999998e-05 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136267+0000", 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022104440000000002 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140087+0000", 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038197069999999999 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140117+0000", 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0156000000000001e-05 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140155+0000", 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8019000000000003e-05 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.00978598, 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286248, 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 73 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129952+0000", 2024-09-18T10:31:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7420000000000002e-06 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129956+0000", 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0289999999999999e-06 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129959+0000", 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134509+0000", 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045500389999999996 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134554+0000", 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4984999999999997e-05 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134633+0000", 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8549999999999998e-05 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136269+0000", 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016365489999999999 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140192+0000", 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039229299999999998 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140217+0000", 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4992000000000001e-05 2024-09-18T10:31:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140236+0000", 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.895e-05 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.009751145999999, 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010335796, 2024-09-18T10:31:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 74 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.204 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129984+0000", 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129989+0000", 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5680000000000001e-06 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129995+0000", 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3350000000000003e-06 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129999+0000", 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9500000000000003e-06 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134856+0000", 2024-09-18T10:31:25.206 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048568020000000003 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134907+0000", 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1450999999999999e-05 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134984+0000", 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6379999999999997e-05 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.207 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136272+0000", 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012878449999999999 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140264+0000", 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039928409999999996 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140289+0000", 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4652999999999999e-05 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.208 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140321+0000", 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1550000000000001e-05 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.009722746000001, 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.01270772, 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.209 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 75 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:25.210 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130094+0000", 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1198000000000004e-05 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.211 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130104+0000", 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5789999999999993e-06 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130114+0000", 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0808000000000001e-05 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135231+0000", 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051164119999999999 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135281+0000", 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0305e-05 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135363+0000", 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2083999999999995e-05 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136275+0000", 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091162199999999995 2024-09-18T10:31:25.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142660+0000", 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063848919999999997 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142698+0000", 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8804999999999999e-05 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.214 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142721+0000", 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2498e-05 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.009613948999998, 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.015446817, 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.215 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 76 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130121+0000", 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130128+0000", 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.161e-06 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130135+0000", 2024-09-18T10:31:25.217 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8189999999999992e-06 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130139+0000", 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7340000000000002e-06 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135853+0000", 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057137840000000004 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.218 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135902+0000", 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9461e-05 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135979+0000", 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6268999999999998e-05 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136467+0000", 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048846600000000001 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145517+0000", 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0090497459999999991 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145546+0000", 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9295999999999999e-05 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145569+0000", 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2697e-05 2024-09-18T10:31:25.220 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:96 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.873864724000001, 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083996039999999998, 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.221 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 96 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265918+0000", 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7209999999999997e-05 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265925+0000", 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9569999999999996e-06 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265928+0000", 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5429999999999998e-06 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268734+0000", 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028057780000000001 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268778+0000", 2024-09-18T10:31:25.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3547000000000002e-05 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268845+0000", 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7162999999999994e-05 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.271236+0000", 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023913910000000001 2024-09-18T10:31:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274205+0000", 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0029687939999999999 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274241+0000", 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6041000000000003e-05 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274271+0000", 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9798000000000002e-05 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.873656086, 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083023239999999998, 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.227 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 98 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:25.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266080+0000", 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266082+0000", 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4990000000000001e-06 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.229 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266087+0000", 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4340000000000002e-06 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266089+0000", 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3690000000000001e-06 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.269815+0000", 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037263330000000001 2024-09-18T10:31:25.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.269857+0000", 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1381999999999998e-05 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.269924+0000", 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7497999999999996e-05 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.271281+0000", 2024-09-18T10:31:25.231 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013569529999999999 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274329+0000", 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0030478150000000002 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274349+0000", 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0021e-05 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274382+0000", 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3342e-05 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.873607483000001, 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083081249999999995, 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.233 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 99 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266128+0000", 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266201+0000", 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2515999999999995e-05 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.235 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266205+0000", 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8130000000000003e-06 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266209+0000", 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5389999999999999e-06 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270099+0000", 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038896099999999999 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270142+0000", 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3142999999999997e-05 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270209+0000", 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.737e-05 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.272000+0000", 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001790795 2024-09-18T10:31:25.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274386+0000", 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023865639999999999 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274407+0000", 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0856000000000002e-05 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274437+0000", 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9298999999999998e-05 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.745293859, 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091240130000000003, 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.239 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 121 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:25.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394445+0000", 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.292e-06 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.241 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394448+0000", 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0819999999999999e-06 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394450+0000", 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9420000000000002e-06 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399432+0000", 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049813349999999999 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399474+0000", 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2061000000000003e-05 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399540+0000", 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6324999999999999e-05 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403485+0000", 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039450300000000004 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.243 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403519+0000", 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3794000000000002e-05 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403547+0000", 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8195999999999999e-05 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403566+0000", 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9236999999999999e-05 2024-09-18T10:31:25.244 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.745283369999999, 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0092440720000000007, 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.245 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 122 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394452+0000", 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394455+0000", 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.728e-06 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394460+0000", 2024-09-18T10:31:25.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1089999999999997e-06 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394463+0000", 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0939999999999999e-06 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399744+0000", 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052808059999999999 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399814+0000", 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9710999999999997e-05 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399928+0000", 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000113885 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403609+0000", 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036813979999999998 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.249 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403616+0000", 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7390000000000002e-06 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403658+0000", 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2373000000000002e-05 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403697+0000", 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8435e-05 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.250 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.745261078999999, 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011099146000000001, 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 123 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:25.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394505+0000", 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0673999999999998e-05 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394511+0000", 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5539999999999997e-06 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394513+0000", 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.52e-06 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400185+0000", 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056715170000000001 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400227+0000", 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2512999999999998e-05 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400322+0000", 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4887000000000001e-05 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403719+0000", 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033967540000000001 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405497+0000", 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001778204 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405542+0000", 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4502000000000002e-05 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405574+0000", 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.745218922999999, 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.016509943999999999, 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 124 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394519+0000", 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.508e-06 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394522+0000", 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.83e-06 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394524+0000", 2024-09-18T10:31:25.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.804e-06 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403059+0000", 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085345979999999991 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403129+0000", 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0043999999999995e-05 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:25.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403245+0000", 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000116123 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.404743+0000", 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001498309 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410948+0000", 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062045370000000004 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410993+0000", 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5629e-05 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.411027+0000", 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3827e-05 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.262 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:25.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:25.264 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:25.262+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:25.284 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:31:25.285 INFO:tasks.rados.rados.0.smithi160.stdout:82: done (3 left) 2024-09-18T10:31:25.285 INFO:tasks.rados.rados.0.smithi160.stdout:83: read oid 11 snap -1 2024-09-18T10:31:25.285 INFO:tasks.rados.rados.0.smithi160.stdout:83: expect deleted 2024-09-18T10:31:25.285 INFO:tasks.rados.rados.0.smithi160.stdout:84: snap_create 2024-09-18T10:31:25.285 INFO:tasks.rados.rados.0.smithi160.stdout:81: finishing rollback tid 0 to smithi16036501-6 2024-09-18T10:31:25.285 INFO:tasks.rados.rados.0.smithi160.stdout:79: expect (ObjNum 32 snap 0 seq_num 32) 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:80: finishing rollback tid 0 to smithi16036501-35 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:80: finishing rollback tid 1 to smithi16036501-35 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:81: finishing rollback tid 1 to smithi16036501-6 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:80: finishing rollback tid 2 to smithi16036501-35 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 35 v 13 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:81: finishing rollback tid 2 to smithi16036501-6 2024-09-18T10:31:25.302 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 6 v 25 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-18T10:31:25.364 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:25.363+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:25.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:25.402 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:25.402 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:25.402 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:25.402 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:25.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:25.466 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:25.465+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:25.508 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:25.508 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:25.508 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:25.508 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:25.508 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:25.508 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:25.509 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:25.517 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:25.524 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:25.525 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:25.540 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:25.540 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:25.556 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:25.556 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:25.566 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:25.565+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:25.571 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:25.571 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:25.585 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:25.586 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:31:25.586 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-09-18T10:31:25.586 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-09-18T10:31:25.586 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:25.587 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:25.604 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:25.604 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:25.617 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpRead(3.1s3 38/33 ECSubRead(tid=74, to_read={3:8a576e44:::smithi16036501-20:head=0,81920,0}, subchunks={3:8a576e44:::smithi16036501-20:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.270574+0000", 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 2.3457974589999999, 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00062120399999999998, 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.618 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270574+0000", 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.619 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270574+0000", 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270573+0000", 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270583+0000", 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4909999999999994e-06 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270600+0000", 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6935999999999998e-05 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.621 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270614+0000", 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4132e-05 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270676+0000", 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1816000000000006e-05 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.622 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271195+0000", 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051906800000000003 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpRead(3.1s3 38/33 ECSubRead(tid=75, to_read={3:8a576e44:::smithi16036501-20:head=0,81920,0}, subchunks={3:8a576e44:::smithi16036501-20:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.270840+0000", 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 2.3455307520000002, 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00082003200000000005, 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.623 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.624 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.624 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270840+0000", 2024-09-18T10:31:25.624 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.625 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.625 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270840+0000", 2024-09-18T10:31:25.625 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.625 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.626 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.626 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270840+0000", 2024-09-18T10:31:25.626 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.626 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.626 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.627 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270848+0000", 2024-09-18T10:31:25.627 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1710000000000002e-06 2024-09-18T10:31:25.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.627 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.627 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.627 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270863+0000", 2024-09-18T10:31:25.628 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5192e-05 2024-09-18T10:31:25.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.628 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.628 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.628 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.270870+0000", 2024-09-18T10:31:25.628 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4789999999999999e-06 2024-09-18T10:31:25.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.629 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.629 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.629 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271541+0000", 2024-09-18T10:31:25.629 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00067083900000000001 2024-09-18T10:31:25.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.630 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.630 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.630 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271660+0000", 2024-09-18T10:31:25.630 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000118983 2024-09-18T10:31:25.630 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.630 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.631 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.631 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.631 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpRead(3.1s3 38/33 ECSubRead(tid=76, to_read={3:8a576e44:::smithi16036501-20:head=0,81920,0}, subchunks={3:8a576e44:::smithi16036501-20:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:25.631 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:23.271970+0000", 2024-09-18T10:31:25.632 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 2.3444009989999999, 2024-09-18T10:31:25.632 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00019822899999999999, 2024-09-18T10:31:25.632 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.632 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271970+0000", 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271970+0000", 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.633 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271969+0000", 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.271980+0000", 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0804e-05 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.272000+0000", 2024-09-18T10:31:25.634 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0514999999999999e-05 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.272010+0000", 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7340000000000003e-06 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.272059+0000", 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8526000000000003e-05 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.635 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:23.272168+0000", 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010956 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 39/33 ECSubWrite(tid=77, reqid=client.4589.0:211, at_version=39'16, trim_to=0'0, roll_forward_to=36'14))", 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.285430+0000", 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.3309408629999999, 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033050219999999999, 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.636 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.285430+0000", 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.285430+0000", 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.637 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.285430+0000", 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286173+0000", 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00074319999999999996 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286188+0000", 2024-09-18T10:31:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4963999999999999e-05 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286196+0000", 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8739999999999995e-06 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.639 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286265+0000", 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9505000000000006e-05 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.286274+0000", 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1990000000000006e-06 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.640 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288706+0000", 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024327400000000001 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288735+0000", 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8736000000000001e-05 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.2s5 39/33 ECSubWrite(tid=5, reqid=client.4589.0:215, at_version=39'4, trim_to=0'0, roll_forward_to=36'2))", 2024-09-18T10:31:25.641 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.287241+0000", 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.3291300850000001, 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0020295790000000001, 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287241+0000", 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.642 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287241+0000", 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287241+0000", 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.643 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287277+0000", 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6640000000000002e-05 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287290+0000", 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2831e-05 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287314+0000", 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3597000000000001e-05 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.644 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287401+0000", 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7560999999999997e-05 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287426+0000", 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4941999999999999e-05 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289230+0000", 2024-09-18T10:31:25.645 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0018037839999999999 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289270+0000", 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0488999999999998e-05 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 39/33 ECSubWrite(tid=78, reqid=client.4589.0:212, at_version=39'17, trim_to=0'0, roll_forward_to=36'14))", 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.287896+0000", 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.328474715, 2024-09-18T10:31:25.646 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0017073189999999999, 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287896+0000", 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287896+0000", 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.287895+0000", 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288018+0000", 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000122471 2024-09-18T10:31:25.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288031+0000", 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2937e-05 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288037+0000", 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2929999999999997e-06 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288135+0000", 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8317000000000001e-05 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288152+0000", 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7011e-05 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289575+0000", 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00142242 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.650 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289604+0000", 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8810999999999999e-05 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 39/33 ECSubWrite(tid=79, reqid=client.4589.0:213, at_version=39'18, trim_to=0'0, roll_forward_to=36'14))", 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.288993+0000", 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.3273779299999999, 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001493121, 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.651 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288993+0000", 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288993+0000", 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.652 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.288992+0000", 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289018+0000", 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6308999999999998e-05 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289074+0000", 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5705000000000003e-05 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289083+0000", 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5790000000000004e-06 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289131+0000", 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7917999999999998e-05 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.289144+0000", 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3582e-05 2024-09-18T10:31:25.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290462+0000", 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013179680000000001 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290486+0000", 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4124000000000001e-05 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.655 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.2s5 39/33 ECSubWrite(tid=6, reqid=client.4589.0:215, at_version=0'0, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.290408+0000", 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.3259625420000001, 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0010289780000000001, 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290408+0000", 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290408+0000", 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290407+0000", 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.657 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290430+0000", 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2052000000000002e-05 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290445+0000", 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5218999999999999e-05 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290452+0000", 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1559999999999998e-06 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290491+0000", 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9480999999999997e-05 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.290500+0000", 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7779999999999996e-06 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.291414+0000", 2024-09-18T10:31:25.659 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091394499999999999 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.291437+0000", 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.334e-05 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 39/33 ECSubWrite(tid=80, reqid=client.4589.0:213, at_version=0'0, trim_to=0'0, roll_forward_to=39'18))", 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.292910+0000", 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 1.32346052, 2024-09-18T10:31:25.660 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00078510600000000004, 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.292910+0000", 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.292910+0000", 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.292908+0000", 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.292944+0000", 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5039000000000001e-05 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.662 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.292980+0000", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6322999999999998e-05 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.293000+0000", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0262999999999999e-05 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.293131+0000", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000131323 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.293155+0000", 2024-09-18T10:31:25.663 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3189000000000001e-05 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.293663+0000", 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00050831699999999999 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.293696+0000", 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2659e-05 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 40/33 ECSubWrite(tid=82, reqid=osd.4.0:82, at_version=40'20, trim_to=0'0, roll_forward_to=39'18))", 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:25.288443+0000", 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.32792804599999997, 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091744799999999996, 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288443+0000", 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288443+0000", 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288443+0000", 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288461+0000", 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8306000000000001e-05 2024-09-18T10:31:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288468+0000", 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8759999999999999e-06 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288481+0000", 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2636000000000001e-05 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.667 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288535+0000", 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3909999999999997e-05 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.288541+0000", 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8229999999999997e-06 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.289333+0000", 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00079118600000000004 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.668 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.289360+0000", 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7810999999999999e-05 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 40/33 ECSubWrite(tid=83, reqid=osd.4.0:82, at_version=0'0, trim_to=0'0, roll_forward_to=40'20))", 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:25.290906+0000", 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.32546491700000002, 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043525949999999999, 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.669 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290906+0000", 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290906+0000", 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.670 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290905+0000", 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290913+0000", 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8339999999999999e-06 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290925+0000", 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1419e-05 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290931+0000", 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9179999999999999e-06 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290967+0000", 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6038999999999998e-05 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.290972+0000", 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3120000000000001e-06 2024-09-18T10:31:25.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.295236+0000", 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042635399999999997 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.295259+0000", 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3113999999999999e-05 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.2s5 40/33 ECSubWrite(tid=7, reqid=osd.14.0:7, at_version=40'6, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:25.293914+0000", 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.32245655200000001, 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0040561720000000002, 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293914+0000", 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293914+0000", 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293914+0000", 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293934+0000", 2024-09-18T10:31:25.675 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0109999999999999e-05 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293946+0000", 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1581e-05 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293952+0000", 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7049999999999996e-06 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.676 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.677 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293988+0000", 2024-09-18T10:31:25.677 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.667e-05 2024-09-18T10:31:25.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.677 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.677 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293994+0000", 2024-09-18T10:31:25.678 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7620000000000001e-06 2024-09-18T10:31:25.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.678 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.678 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.678 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.297949+0000", 2024-09-18T10:31:25.678 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039547489999999996 2024-09-18T10:31:25.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.679 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.679 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.679 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.297971+0000", 2024-09-18T10:31:25.679 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1892999999999999e-05 2024-09-18T10:31:25.679 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.680 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.680 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.680 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.2s5 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:31:25.680 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:25.298889+0000", 2024-09-18T10:31:25.681 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.31748177100000002, 2024-09-18T10:31:25.681 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.002000178, 2024-09-18T10:31:25.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:25.681 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:25.681 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:25.681 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.682 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:25.682 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298889+0000", 2024-09-18T10:31:25.682 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.682 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.682 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298889+0000", 2024-09-18T10:31:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:25.683 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298884+0000", 2024-09-18T10:31:25.684 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999943 2024-09-18T10:31:25.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.684 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.684 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:25.684 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298900+0000", 2024-09-18T10:31:25.684 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5906e-05 2024-09-18T10:31:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298911+0000", 2024-09-18T10:31:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1601e-05 2024-09-18T10:31:25.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.686 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.686 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:25.686 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298916+0000", 2024-09-18T10:31:25.686 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4209999999999997e-06 2024-09-18T10:31:25.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.686 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.687 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:25.687 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298965+0000", 2024-09-18T10:31:25.687 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9789000000000001e-05 2024-09-18T10:31:25.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.687 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.687 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:25.688 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298975+0000", 2024-09-18T10:31:25.688 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5489999999999995e-06 2024-09-18T10:31:25.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.688 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.688 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:25.688 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.300870+0000", 2024-09-18T10:31:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0018952859999999999 2024-09-18T10:31:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.300889+0000", 2024-09-18T10:31:25.689 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9177999999999998e-05 2024-09-18T10:31:25.690 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.690 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.690 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.690 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:25.690 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:25.690 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:25.692 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:25.693 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:25.691+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:25.693 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:25.694 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:25.694 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:25.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:25.695 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:25.695 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:25.696 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:25.696 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:25.697 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:25.709 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:25.709 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:25.725 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:25.725 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:25.740 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:25.740 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:25.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:25.740+0000 7fdb56d9d640 0 -- 172.21.15.63:0/788033109 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7fdb58197dc0 msgr2=0x7fdb5819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:25.793 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:25.792+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:25.794 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:25.794 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:25.803 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:25.874 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:25.875 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:25.886 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-18T10:31:25.278540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13468211,"num_objects":28,"num_object_clones":4,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":143,"num_read_kb":4757,"num_write":248,"num_write_kb":15810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":4772104,"kb_used_data":14328,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505177336,"statfs":{"total":1546188226560,"available":1541301592064,"internally_reserved":0,"allocated":14671872,"data_stored":13582077,"data_compressed":646250,"data_compressed_allocated":946176,"data_compressed_original":2785280,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12877824,"num_objects":24,"num_object_clones":4,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":57,"num_read_kb":4684,"num_write":101,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019938"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.659759+0000","last_change":"2024-09-18T10:31:19.654257+0000","last_active":"2024-09-18T10:31:19.659759+0000","last_peered":"2024-09-18T10:31:19.659759+0000","last_clean":"2024-09-18T10:31:19.659759+0000","last_became_active":"2024-09-18T10:31:19.653467+0000","last_became_peered":"2024-09-18T10:31:19.653467+0000","last_unstale":"2024-09-18T10:31:19.659759+0000","last_undegraded":"2024-09-18T10:31:19.659759+0000","last_fullsized":"2024-09-18T10:31:19.659759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.811199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.665096+0000","last_change":"2024-09-18T10:31:19.656017+0000","last_active":"2024-09-18T10:31:19.665096+0000","last_peered":"2024-09-18T10:31:19.665096+0000","last_clean":"2024-09-18T10:31:19.665096+0000","last_became_active":"2024-09-18T10:31:19.655410+0000","last_became_peered":"2024-09-18T10:31:19.655410+0000","last_unstale":"2024-09-18T10:31:19.665096+0000","last_undegraded":"2024-09-18T10:31:19.665096+0000","last_fullsized":"2024-09-18T10:31:19.665096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.418469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.662703+0000","last_change":"2024-09-18T10:31:19.659006+0000","last_active":"2024-09-18T10:31:19.662703+0000","last_peered":"2024-09-18T10:31:19.662703+0000","last_clean":"2024-09-18T10:31:19.662703+0000","last_became_active":"2024-09-18T10:31:19.658019+0000","last_became_peered":"2024-09-18T10:31:19.658019+0000","last_unstale":"2024-09-18T10:31:19.662703+0000","last_undegraded":"2024-09-18T10:31:19.662703+0000","last_fullsized":"2024-09-18T10:31:19.662703+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.132541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.662815+0000","last_change":"2024-09-18T10:31:19.656514+0000","last_active":"2024-09-18T10:31:19.662815+0000","last_peered":"2024-09-18T10:31:19.662815+0000","last_clean":"2024-09-18T10:31:19.662815+0000","last_became_active":"2024-09-18T10:31:19.654704+0000","last_became_peered":"2024-09-18T10:31:19.654704+0000","last_unstale":"2024-09-18T10:31:19.662815+0000","last_undegraded":"2024-09-18T10:31:19.662815+0000","last_fullsized":"2024-09-18T10:31:19.662815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:40.031783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"36'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-18T10:31:23.270383+0000","last_change":"2024-09-18T10:31:19.660093+0000","last_active":"2024-09-18T10:31:23.270383+0000","last_peered":"2024-09-18T10:31:23.270383+0000","last_clean":"2024-09-18T10:31:23.270383+0000","last_became_active":"2024-09-18T10:31:19.659120+0000","last_became_peered":"2024-09-18T10:31:19.659120+0000","last_unstale":"2024-09-18T10:31:23.270383+0000","last_undegraded":"2024-09-18T10:31:23.270383+0000","last_fullsized":"2024-09-18T10:31:23.270383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.157665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":10,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.662668+0000","last_change":"2024-09-18T10:31:19.657688+0000","last_active":"2024-09-18T10:31:19.662668+0000","last_peered":"2024-09-18T10:31:19.662668+0000","last_clean":"2024-09-18T10:31:19.662668+0000","last_became_active":"2024-09-18T10:31:19.656939+0000","last_became_peered":"2024-09-18T10:31:19.656939+0000","last_unstale":"2024-09-18T10:31:19.662668+0000","last_undegraded":"2024-09-18T10:31:19.662668+0000","last_fullsized":"2024-09-18T10:31:19.662668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.835368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.665010+0000","last_change":"2024-09-18T10:31:19.658121+0000","last_active":"2024-09-18T10:31:19.665010+0000","last_peered":"2024-09-18T10:31:19.665010+0000","last_clean":"2024-09-18T10:31:19.665010+0000","last_became_active":"2024-09-18T10:31:19.656490+0000","last_became_peered":"2024-09-18T10:31:19.656490+0000","last_unstale":"2024-09-18T10:31:19.665010+0000","last_undegraded":"2024-09-18T10:31:19.665010+0000","last_fullsized":"2024-09-18T10:31:19.665010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.159673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.661743+0000","last_change":"2024-09-18T10:31:19.657442+0000","last_active":"2024-09-18T10:31:19.661743+0000","last_peered":"2024-09-18T10:31:19.661743+0000","last_clean":"2024-09-18T10:31:19.661743+0000","last_became_active":"2024-09-18T10:31:19.656901+0000","last_became_peered":"2024-09-18T10:31:19.656901+0000","last_unstale":"2024-09-18T10:31:19.661743+0000","last_undegraded":"2024-09-18T10:31:19.661743+0000","last_fullsized":"2024-09-18T10:31:19.661743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:24.257154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"26'112","reported_seq":155,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.255958+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:19.255958+0000","last_peered":"2024-09-18T10:31:19.255958+0000","last_clean":"2024-09-18T10:31:19.255958+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:19.255958+0000","last_undegraded":"2024-09-18T10:31:19.255958+0000","last_fullsized":"2024-09-18T10:31:19.255958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.256038+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:19.256038+0000","last_peered":"2024-09-18T10:31:19.256038+0000","last_clean":"2024-09-18T10:31:19.256038+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:19.256038+0000","last_undegraded":"2024-09-18T10:31:19.256038+0000","last_fullsized":"2024-09-18T10:31:19.256038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.661672+0000","last_change":"2024-09-18T10:31:19.657324+0000","last_active":"2024-09-18T10:31:19.661672+0000","last_peered":"2024-09-18T10:31:19.661672+0000","last_clean":"2024-09-18T10:31:19.661672+0000","last_became_active":"2024-09-18T10:31:19.656832+0000","last_became_peered":"2024-09-18T10:31:19.656832+0000","last_unstale":"2024-09-18T10:31:19.661672+0000","last_undegraded":"2024-09-18T10:31:19.661672+0000","last_fullsized":"2024-09-18T10:31:19.661672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:45.003864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.339415+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:19.339415+0000","last_peered":"2024-09-18T10:31:19.339415+0000","last_clean":"2024-09-18T10:31:19.339415+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:19.339415+0000","last_undegraded":"2024-09-18T10:31:19.339415+0000","last_fullsized":"2024-09-18T10:31:19.339415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"36'15","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-18T10:31:23.273281+0000","last_change":"2024-09-18T10:31:19.657747+0000","last_active":"2024-09-18T10:31:23.273281+0000","last_peered":"2024-09-18T10:31:23.273281+0000","last_clean":"2024-09-18T10:31:23.273281+0000","last_became_active":"2024-09-18T10:31:19.657050+0000","last_became_peered":"2024-09-18T10:31:19.657050+0000","last_unstale":"2024-09-18T10:31:23.273281+0000","last_undegraded":"2024-09-18T10:31:23.273281+0000","last_fullsized":"2024-09-18T10:31:23.273281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.836363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3178496,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":4664,"num_write":15,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.255391+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:19.255391+0000","last_peered":"2024-09-18T10:31:19.255391+0000","last_clean":"2024-09-18T10:31:19.255391+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:19.255391+0000","last_undegraded":"2024-09-18T10:31:19.255391+0000","last_fullsized":"2024-09-18T10:31:19.255391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.657708+0000","last_change":"2024-09-18T10:31:19.654502+0000","last_active":"2024-09-18T10:31:19.657708+0000","last_peered":"2024-09-18T10:31:19.657708+0000","last_clean":"2024-09-18T10:31:19.657708+0000","last_became_active":"2024-09-18T10:31:19.653500+0000","last_became_peered":"2024-09-18T10:31:19.653500+0000","last_unstale":"2024-09-18T10:31:19.657708+0000","last_undegraded":"2024-09-18T10:31:19.657708+0000","last_fullsized":"2024-09-18T10:31:19.657708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.254826+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:19.254826+0000","last_peered":"2024-09-18T10:31:19.254826+0000","last_clean":"2024-09-18T10:31:19.254826+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:19.254826+0000","last_undegraded":"2024-09-18T10:31:19.254826+0000","last_fullsized":"2024-09-18T10:31:19.254826+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.656939+0000","last_change":"2024-09-18T10:31:19.654061+0000","last_active":"2024-09-18T10:31:19.656939+0000","last_peered":"2024-09-18T10:31:19.656939+0000","last_clean":"2024-09-18T10:31:19.656939+0000","last_became_active":"2024-09-18T10:31:19.653308+0000","last_became_peered":"2024-09-18T10:31:19.653308+0000","last_unstale":"2024-09-18T10:31:19.656939+0000","last_undegraded":"2024-09-18T10:31:19.656939+0000","last_fullsized":"2024-09-18T10:31:19.656939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.003091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.662804+0000","last_change":"2024-09-18T10:31:19.655745+0000","last_active":"2024-09-18T10:31:19.662804+0000","last_peered":"2024-09-18T10:31:19.662804+0000","last_clean":"2024-09-18T10:31:19.662804+0000","last_became_active":"2024-09-18T10:31:19.654834+0000","last_became_peered":"2024-09-18T10:31:19.654834+0000","last_unstale":"2024-09-18T10:31:19.662804+0000","last_undegraded":"2024-09-18T10:31:19.662804+0000","last_fullsized":"2024-09-18T10:31:19.662804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:30.217482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-18T10:31:23.270188+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:23.270188+0000","last_peered":"2024-09-18T10:31:23.270188+0000","last_clean":"2024-09-18T10:31:23.270188+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:23.270188+0000","last_undegraded":"2024-09-18T10:31:23.270188+0000","last_fullsized":"2024-09-18T10:31:23.270188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.655571+0000","last_change":"2024-09-18T10:31:19.654229+0000","last_active":"2024-09-18T10:31:19.655571+0000","last_peered":"2024-09-18T10:31:19.655571+0000","last_clean":"2024-09-18T10:31:19.655571+0000","last_became_active":"2024-09-18T10:31:19.653632+0000","last_became_peered":"2024-09-18T10:31:19.653632+0000","last_unstale":"2024-09-18T10:31:19.655571+0000","last_undegraded":"2024-09-18T10:31:19.655571+0000","last_fullsized":"2024-09-18T10:31:19.655571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:42.743288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.246969+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:19.246969+0000","last_peered":"2024-09-18T10:31:19.246969+0000","last_clean":"2024-09-18T10:31:19.246969+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:19.246969+0000","last_undegraded":"2024-09-18T10:31:19.246969+0000","last_fullsized":"2024-09-18T10:31:19.246969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"39'18","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-18T10:31:24.292652+0000","last_change":"2024-09-18T10:31:19.260875+0000","last_active":"2024-09-18T10:31:24.292652+0000","last_peered":"2024-09-18T10:31:24.292652+0000","last_clean":"2024-09-18T10:31:24.292652+0000","last_became_active":"2024-09-18T10:31:19.259917+0000","last_became_peered":"2024-09-18T10:31:19.259917+0000","last_unstale":"2024-09-18T10:31:24.292652+0000","last_undegraded":"2024-09-18T10:31:24.292652+0000","last_fullsized":"2024-09-18T10:31:24.292652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.414788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3424256,"num_objects":6,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":36,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.254994+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:19.254994+0000","last_peered":"2024-09-18T10:31:19.254994+0000","last_clean":"2024-09-18T10:31:19.254994+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:19.254994+0000","last_undegraded":"2024-09-18T10:31:19.254994+0000","last_fullsized":"2024-09-18T10:31:19.254994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"39'25","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-18T10:31:24.329395+0000","last_change":"2024-09-18T10:31:19.657316+0000","last_active":"2024-09-18T10:31:24.329395+0000","last_peered":"2024-09-18T10:31:24.329395+0000","last_clean":"2024-09-18T10:31:24.329395+0000","last_became_active":"2024-09-18T10:31:19.653910+0000","last_became_peered":"2024-09-18T10:31:19.653910+0000","last_unstale":"2024-09-18T10:31:24.329395+0000","last_undegraded":"2024-09-18T10:31:24.329395+0000","last_fullsized":"2024-09-18T10:31:24.329395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.757231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4308992,"num_objects":9,"num_object_clones":3,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":40,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-18T10:31:19.254852+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:19.254852+0000","last_peered":"2024-09-18T10:31:19.254852+0000","last_clean":"2024-09-18T10:31:19.254852+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:19.254852+0000","last_undegraded":"2024-09-18T10:31:19.254852+0000","last_fullsized":"2024-09-18T10:31:19.254852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":12877824,"num_objects":24,"num_object_clones":4,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":57,"num_read_kb":4684,"num_write":101,"num_write_kb":13136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8704000,"data_stored":9428992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":413696,"data_stored":717946,"data_compressed":47772,"data_compressed_allocated":86016,"data_compressed_original":618496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":14,"up_from":22,"seq":94489280519,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":189018,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":13,"up_from":22,"seq":94489280519,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":189037,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]},{"osd":0,"up_from":21,"seq":90194313224,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":4396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":4501504,"data_stored":4694174,"data_compressed":49743,"data_compressed_allocated":69632,"data_compressed_original":139264,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,5,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":1,"up_from":21,"seq":90194313225,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299100,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072740,"statfs":{"total":96636764160,"available":96330485760,"internally_reserved":0,"allocated":1785856,"data_stored":1749150,"data_compressed":49743,"data_compressed_allocated":69632,"data_compressed_original":139264,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":4,"up_from":21,"seq":90194313225,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300916,"kb_used_data":3560,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070924,"statfs":{"total":96636764160,"available":96328626176,"internally_reserved":0,"allocated":3645440,"data_stored":3674270,"data_compressed":49743,"data_compressed_allocated":69632,"data_compressed_original":139264,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":2,"up_from":22,"seq":94489280519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":189018,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":22,"seq":94489280519,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":5,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":189018,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":6,"up_from":22,"seq":94489280518,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":401408,"data_stored":707817,"data_compressed":44804,"data_compressed_allocated":81920,"data_compressed_original":610304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":7,"up_from":22,"seq":94489280519,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":189018,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":8,"up_from":22,"seq":94489280520,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":10,"up_from":22,"seq":94489280519,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074140,"statfs":{"total":96636764160,"available":96331919360,"internally_reserved":0,"allocated":348160,"data_stored":178889,"data_compressed":34879,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280518,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":360448,"data_stored":189018,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":12,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":364544,"data_stored":189037,"data_compressed":37847,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4091904,"data_stored":4464640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1376256,"data_stored":1519616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3235840,"data_stored":3444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:25.890 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-09-18T10:31:25.894 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:25.893+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:25.901 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:25.901 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:25.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:25.958 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:25.995 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:25.994+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:26.048 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.048 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.057 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:26.101 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:26.100+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:26.167 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.167 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.176 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:26.197 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:26.195+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:26.289 INFO:tasks.rados.rados.0.smithi160.stdout:79: done (4 left) 2024-09-18T10:31:26.289 INFO:tasks.rados.rados.0.smithi160.stdout:80: done (3 left) 2024-09-18T10:31:26.289 INFO:tasks.rados.rados.0.smithi160.stdout:81: done (2 left) 2024-09-18T10:31:26.289 INFO:tasks.rados.rados.0.smithi160.stdout:83: done (1 left) 2024-09-18T10:31:26.289 INFO:tasks.rados.rados.0.smithi160.stdout:84: done (0 left) 2024-09-18T10:31:26.289 INFO:tasks.rados.rados.0.smithi160.stdout:85: delete oid 46 current snap is 4 2024-09-18T10:31:26.291 INFO:tasks.rados.rados.0.smithi160.stdout:85: done (0 left) 2024-09-18T10:31:26.291 INFO:tasks.rados.rados.0.smithi160.stdout:86: delete oid 10 current snap is 4 2024-09-18T10:31:26.297 INFO:tasks.rados.rados.0.smithi160.stdout:86: done (0 left) 2024-09-18T10:31:26.297 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 32 current snap is 4 2024-09-18T10:31:26.297 INFO:tasks.rados.rados.0.smithi160.stdout:87: seq_num 67 ranges {524288=753664,1277952=376832} 2024-09-18T10:31:26.297 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:26.296+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:26.303 INFO:tasks.rados.rados.0.smithi160.stdout:87: writing smithi16036501-32 from 524288 to 1277952 tid 1 2024-09-18T10:31:26.305 INFO:tasks.rados.rados.0.smithi160.stdout:87: writing smithi16036501-32 from 1277952 to 1654784 tid 2 2024-09-18T10:31:26.305 INFO:tasks.rados.rados.0.smithi160.stdout:88: snap_remove snap 0 2024-09-18T10:31:26.320 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.320 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.329 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:26.398 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:26.397+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:26.427 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.427 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.435 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:26.499 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:26.498+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:26.533 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.533 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.541 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:26.600 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:26.599+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:26.639 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.640 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.648 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:26.701 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:26.700+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:26.745 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.746 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:26.802 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:26.801+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:26.851 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.852 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.860 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:26.903 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:26.903+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:26.957 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:26.957 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:26.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:27.011 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:27.010+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:27.063 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.064 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.072 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:31:27.105 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:27.104+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:27.206 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:27.205+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:27.209 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.210 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.218 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:88: done (1 left) 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:89: read oid 37 snap 3 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:89: expect (ObjNum 36 snap 0 seq_num 36) 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:90: rollback oid 9 current snap is 4 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 9 to 2 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:87: finishing write tid 1 to smithi16036501-32 2024-09-18T10:31:27.297 INFO:tasks.rados.rados.0.smithi160.stdout:87: finishing write tid 2 to smithi16036501-32 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:87: finishing write tid 3 to smithi16036501-32 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:87: finishing write tid 4 to smithi16036501-32 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 32 v 8 (ObjNum 67 snap 4 seq_num 67) dirty exists 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:87: left oid 32 (ObjNum 67 snap 4 seq_num 67) 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:87: done (2 left) 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 38 current snap is 4 2024-09-18T10:31:27.298 INFO:tasks.rados.rados.0.smithi160.stdout:91: seq_num 68 ranges {622592=770048,1392640=376832} 2024-09-18T10:31:27.303 INFO:tasks.rados.rados.0.smithi160.stdout:91: writing smithi16036501-38 from 622592 to 1392640 tid 1 2024-09-18T10:31:27.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:31:27.306 INFO:tasks.rados.rados.0.smithi160.stdout:91: writing smithi16036501-38 from 1392640 to 1769472 tid 2 2024-09-18T10:31:27.306 INFO:tasks.rados.rados.0.smithi160.stdout:92: copy_from oid 23 from oid 11 current snap is 4 2024-09-18T10:31:27.306 INFO:tasks.rados.rados.0.smithi160.stdout:90: finishing rollback tid 0 to smithi16036501-9 2024-09-18T10:31:27.306 INFO:tasks.rados.rados.0.smithi160.stdout:90: finishing rollback tid 1 to smithi16036501-9 2024-09-18T10:31:27.306 INFO:tasks.rados.rados.0.smithi160.stdout:90: finishing rollback tid 2 to smithi16036501-9 2024-09-18T10:31:27.306 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 9 v 9 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-18T10:31:27.307 INFO:tasks.rados.rados.0.smithi160.stdout:90: done (3 left) 2024-09-18T10:31:27.307 INFO:tasks.rados.rados.0.smithi160.stdout:93: setattr oid 41 current snap is 4 2024-09-18T10:31:27.308 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:27.305+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:94: read oid 32 snap -1 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:94: expect (ObjNum 67 snap 4 seq_num 67) 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:95: rollback oid 18 current snap is 4 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 18 to 3 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:96: read oid 27 snap -1 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:96: expect deleted 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 4 current snap is 4 2024-09-18T10:31:27.310 INFO:tasks.rados.rados.0.smithi160.stdout:97: seq_num 69 ranges {65536=786432,851968=376832} 2024-09-18T10:31:27.314 INFO:tasks.rados.rados.0.smithi160.stdout:97: writing smithi16036501-4 from 65536 to 851968 tid 1 2024-09-18T10:31:27.316 INFO:tasks.rados.rados.0.smithi160.stdout:97: writing smithi16036501-4 from 851968 to 1228800 tid 2 2024-09-18T10:31:27.317 INFO:tasks.rados.rados.0.smithi160.stdout:98: rollback oid 22 current snap is 4 2024-09-18T10:31:27.317 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 22 to 2 2024-09-18T10:31:27.317 INFO:tasks.rados.rados.0.smithi160.stdout:89: expect (ObjNum 36 snap 0 seq_num 36) 2024-09-18T10:31:27.328 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.328 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:92: finishing copy_from to smithi16036501-23 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:92: got expected ENOENT (src dne) 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:92: finishing copy_from racing read to smithi16036501-23 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:95: finishing rollback tid 1 to smithi16036501-18 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 18 v 0 (ObjNum 129 snap 0 seq_num 1498836124) dirty dne 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:91: finishing write tid 1 to smithi16036501-38 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:91: finishing write tid 2 to smithi16036501-38 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:91: finishing write tid 3 to smithi16036501-38 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 41 v 35 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-18T10:31:27.336 INFO:tasks.rados.rados.0.smithi160.stdout:91: finishing write tid 4 to smithi16036501-38 2024-09-18T10:31:27.337 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 12 (ObjNum 68 snap 4 seq_num 68) dirty exists 2024-09-18T10:31:27.337 INFO:tasks.rados.rados.0.smithi160.stdout:91: left oid 38 (ObjNum 68 snap 4 seq_num 68) 2024-09-18T10:31:27.337 INFO:tasks.rados.rados.0.smithi160.stdout:94: expect (ObjNum 67 snap 4 seq_num 67) 2024-09-18T10:31:27.338 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:31:27.389 INFO:tasks.rados.rados.0.smithi160.stdout:97: finishing write tid 1 to smithi16036501-4 2024-09-18T10:31:27.389 INFO:tasks.rados.rados.0.smithi160.stdout:89: done (8 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:91: done (7 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:92: done (6 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:93: done (5 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:94: done (4 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:95: done (3 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:96: done (2 left) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:99: read oid 12 snap -1 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:99: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:100: delete oid 33 current snap is 4 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:97: finishing write tid 2 to smithi16036501-4 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:97: finishing write tid 3 to smithi16036501-4 2024-09-18T10:31:27.390 INFO:tasks.rados.rados.0.smithi160.stdout:97: finishing write tid 4 to smithi16036501-4 2024-09-18T10:31:27.391 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 4 v 18 (ObjNum 69 snap 4 seq_num 69) dirty exists 2024-09-18T10:31:27.391 INFO:tasks.rados.rados.0.smithi160.stdout:97: left oid 4 (ObjNum 69 snap 4 seq_num 69) 2024-09-18T10:31:27.391 INFO:tasks.rados.rados.0.smithi160.stdout:98: finishing rollback tid 0 to smithi16036501-22 2024-09-18T10:31:27.391 INFO:tasks.rados.rados.0.smithi160.stdout:98: finishing rollback tid 1 to smithi16036501-22 2024-09-18T10:31:27.391 INFO:tasks.rados.rados.0.smithi160.stdout:98: finishing rollback tid 2 to smithi16036501-22 2024-09-18T10:31:27.391 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 22 v 22 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-18T10:31:27.392 INFO:tasks.rados.rados.0.smithi160.stdout:97: done (3 left) 2024-09-18T10:31:27.393 INFO:tasks.rados.rados.0.smithi160.stdout:98: done (2 left) 2024-09-18T10:31:27.393 INFO:tasks.rados.rados.0.smithi160.stdout:100: done (1 left) 2024-09-18T10:31:27.393 INFO:tasks.rados.rados.0.smithi160.stdout:101: rollback oid 37 current snap is 4 2024-09-18T10:31:27.393 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 37 to 3 2024-09-18T10:31:27.393 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 38 current snap is 4 2024-09-18T10:31:27.393 INFO:tasks.rados.rados.0.smithi160.stdout:102: seq_num 71 ranges {1769472=425984,2195456=573440,2768896=196608} 2024-09-18T10:31:27.403 INFO:tasks.rados.rados.0.smithi160.stdout:102: writing smithi16036501-38 from 1769472 to 2195456 tid 1 2024-09-18T10:31:27.407 INFO:tasks.rados.rados.0.smithi160.stdout:102: writing smithi16036501-38 from 2195456 to 2768896 tid 2 2024-09-18T10:31:27.407 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:27.406+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:27.409 INFO:tasks.rados.rados.0.smithi160.stdout:102: writing smithi16036501-38 from 2768896 to 2965504 tid 3 2024-09-18T10:31:27.409 INFO:tasks.rados.rados.0.smithi160.stdout:103: snap_create 2024-09-18T10:31:27.409 INFO:tasks.rados.rados.0.smithi160.stdout:99: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-18T10:31:27.415 INFO:tasks.rados.rados.0.smithi160.stdout:101: finishing rollback tid 0 to smithi16036501-37 2024-09-18T10:31:27.416 INFO:tasks.rados.rados.0.smithi160.stdout:101: finishing rollback tid 1 to smithi16036501-37 2024-09-18T10:31:27.416 INFO:tasks.rados.rados.0.smithi160.stdout:101: finishing rollback tid 2 to smithi16036501-37 2024-09-18T10:31:27.416 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 26 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-18T10:31:27.416 INFO:tasks.rados.rados.0.smithi160.stdout:102: finishing write tid 1 to smithi16036501-38 2024-09-18T10:31:27.416 INFO:tasks.rados.rados.0.smithi160.stdout:102: finishing write tid 2 to smithi16036501-38 2024-09-18T10:31:27.416 INFO:tasks.rados.rados.0.smithi160.stdout:102: finishing write tid 3 to smithi16036501-38 2024-09-18T10:31:27.417 INFO:tasks.rados.rados.0.smithi160.stdout:102: finishing write tid 4 to smithi16036501-38 2024-09-18T10:31:27.418 INFO:tasks.rados.rados.0.smithi160.stdout:102: finishing write tid 5 to smithi16036501-38 2024-09-18T10:31:27.418 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 16 (ObjNum 71 snap 4 seq_num 71) dirty exists 2024-09-18T10:31:27.418 INFO:tasks.rados.rados.0.smithi160.stdout:102: left oid 38 (ObjNum 71 snap 4 seq_num 71) 2024-09-18T10:31:27.441 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.441 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.449 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:27.508 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:27.507+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:27.552 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.553 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.561 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:27.609 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:27.608+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:27.665 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.665 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:27.717 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:27.716+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:27.775 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.775 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:27.810 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:27.809+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:27.912 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:27.911+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:27.926 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:27.926 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:27.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:27.970 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:28.013 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:28.012+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:28.038 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:28.039 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:28.047 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:28.098 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:28.098 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:28.114 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:28.113+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:28.115 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:28.115 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:28.131 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:28.148 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:28.150 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:28.151 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:28.159 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:28.162 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:28.163 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:28.179 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:28.179 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:28.195 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:28.196 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:28.215 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:28.214+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:28.226 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:28.226 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:28.248 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:28.249 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:28.264 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:28.265 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:28.280 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:28.281 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:28.281 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:28.281 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:28.281 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:28.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:28.295 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:31:28.297 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:28.297 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:28.297 INFO:tasks.rados.rados.0.smithi160.stdout:99: done (3 left) 2024-09-18T10:31:28.298 INFO:tasks.rados.rados.0.smithi160.stdout:101: done (2 left) 2024-09-18T10:31:28.298 INFO:tasks.rados.rados.0.smithi160.stdout:102: done (1 left) 2024-09-18T10:31:28.298 INFO:tasks.rados.rados.0.smithi160.stdout:103: done (0 left) 2024-09-18T10:31:28.298 INFO:tasks.rados.rados.0.smithi160.stdout:104: snap_remove snap 2 2024-09-18T10:31:28.313 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:28.316 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:28.315+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:28.329 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:28.330 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:28.362 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:28.362 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:28.403 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:28.403 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:28.403 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:28.412 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:28.416 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:28.415+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:28.518 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:28.517+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.cs1 39/33 ECSubRead(tid=36, to_read={3:3616aa10:::smithi16036501-19:head=0,294912,0}, subchunks={3:3616aa10:::smithi16036501-19:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:28.555 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274795+0000", 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.2798476379999997, 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010889140000000001, 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274795+0000", 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274795+0000", 2024-09-18T10:31:28.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274794+0000", 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274807+0000", 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3054000000000001e-05 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274842+0000", 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4619000000000002e-05 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274884+0000", 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1690000000000002e-05 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274981+0000", 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6928000000000004e-05 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275884+0000", 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090295000000000002 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.cs1 39/33 ECSubRead(tid=37, to_read={3:3616aa10:::smithi16036501-19:head=0,294912,0}, subchunks={3:3616aa10:::smithi16036501-19:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.27972033, 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012142590000000001, 2024-09-18T10:31:28.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:28.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274927+0000", 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1410000000000004e-06 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274935+0000", 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0940000000000008e-06 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274943+0000", 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8110000000000003e-06 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275927+0000", 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0009837540000000001 2024-09-18T10:31:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276136+0000", 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020977100000000001 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.cs1 39/33 ECSubRead(tid=38, to_read={3:3616aa10:::smithi16036501-19:head=0,294912,0}, subchunks={3:3616aa10:::smithi16036501-19:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.2784760330000005, 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032113999999999998, 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:28.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:28.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276176+0000", 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8579999999999995e-06 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276194+0000", 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7938999999999999e-05 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276202+0000", 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5720000000000003e-06 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276257+0000", 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4638000000000001e-05 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276487+0000", 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023069799999999999 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.567 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.567 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:28.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:28.619 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:28.617+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:28.670 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:28.671 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:28.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:28.720 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:28.719+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:28.821 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:28.819+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:28.821 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:28.821 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:28.822 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:28.822 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:28.822 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:28.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:28.922 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:28.921+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:28.931 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4356.0:5 2.2 e28/26 2:5cea7035:::rbd_info:head v 28'1, mlcod=0'0)", 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:06.180410+0000", 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 22.750924974, 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00091577900000000003, 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:28.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180410+0000", 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180410+0000", 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:28.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180410+0000", 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180429+0000", 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8787000000000002e-05 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180457+0000", 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8793e-05 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180471+0000", 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3016999999999999e-05 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180572+0000", 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101346 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.180618+0000", 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6202000000000003e-05 2024-09-18T10:31:28.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.181280+0000", 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00066198099999999996 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:06.181326+0000", 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6159999999999999e-05 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4356.0:7 2.2 e29/26 2:5cea7035:::rbd_info:head v 29'2, mlcod=0'0)", 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:07.190650+0000", 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.740685809999999, 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085881599999999998, 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:28.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190650+0000", 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190650+0000", 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190649+0000", 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190657+0000", 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3719999999999999e-06 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190678+0000", 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0976e-05 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190690+0000", 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2272999999999999e-05 2024-09-18T10:31:28.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190746+0000", 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5679e-05 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.190763+0000", 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7288000000000001e-05 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:28.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.191473+0000", 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00071044499999999998 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:07.191508+0000", 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5052999999999998e-05 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:28.941 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:28.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:29.023 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:29.022+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:29.051 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.052 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:29.052 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:29.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:29.124 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:29.123+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:29.158 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.158 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:29.158 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:29.158 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:29.158 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:29.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:29.224 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:29.224+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:29.265 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.266 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:29.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:29.266 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:29.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.266 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 39/33 ECSubWrite(tid=5, reqid=client.4589.0:215, at_version=39'4, trim_to=0'0, roll_forward_to=36'2))", 2024-09-18T10:31:29.266 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.287152+0000", 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9772583399999997, 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011324950000000001, 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287152+0000", 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287152+0000", 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287152+0000", 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287180+0000", 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8425e-05 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287191+0000", 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0458999999999999e-05 2024-09-18T10:31:29.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287197+0000", 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7320000000000001e-06 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287246+0000", 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8671999999999997e-05 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287256+0000", 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9490000000000008e-06 2024-09-18T10:31:29.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.288259+0000", 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001003423 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.288284+0000", 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4960000000000002e-05 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.274 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 39/33 ECSubWrite(tid=6, reqid=client.4589.0:215, at_version=0'0, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.290394+0000", 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.974016099, 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053323200000000002, 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290394+0000", 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290394+0000", 2024-09-18T10:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290394+0000", 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290402+0000", 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5399999999999996e-06 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290412+0000", 2024-09-18T10:31:29.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8090000000000004e-06 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290416+0000", 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2339999999999996e-06 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290445+0000", 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8727000000000001e-05 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290449+0000", 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6330000000000004e-06 2024-09-18T10:31:29.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290907+0000", 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045704799999999999 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.290927+0000", 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0871999999999999e-05 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 39/33 ECSubWrite(tid=59, reqid=client.4589.0:219, at_version=39'11, trim_to=0'0, roll_forward_to=36'9))", 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322958+0000", 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9414522989999998, 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097891499999999991, 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322958+0000", 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322958+0000", 2024-09-18T10:31:29.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322958+0000", 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322979+0000", 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0837999999999999e-05 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322987+0000", 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5990000000000002e-06 2024-09-18T10:31:29.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322993+0000", 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8710000000000002e-06 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323054+0000", 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0847000000000002e-05 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323063+0000", 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6700000000000006e-06 2024-09-18T10:31:29.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323913+0000", 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084907299999999999 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323937+0000", 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4317000000000001e-05 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 39/33 ECSubWrite(tid=60, reqid=client.4589.0:220, at_version=39'12, trim_to=0'0, roll_forward_to=36'9))", 2024-09-18T10:31:29.290 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.323983+0000", 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9404277639999998, 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062231199999999997, 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323983+0000", 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323983+0000", 2024-09-18T10:31:29.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323982+0000", 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323996+0000", 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4032999999999999e-05 2024-09-18T10:31:29.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324006+0000", 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0098999999999999e-05 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324012+0000", 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8320000000000002e-06 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324066+0000", 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4147000000000002e-05 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324076+0000", 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8830000000000001e-06 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324581+0000", 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050515599999999999 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324605+0000", 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3706e-05 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 39/33 ECSubWrite(tid=61, reqid=client.4589.0:221, at_version=39'13, trim_to=0'0, roll_forward_to=36'9))", 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.324734+0000", 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9396760369999999, 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001478325, 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.296 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324734+0000", 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324734+0000", 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324734+0000", 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324757+0000", 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2926e-05 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324771+0000", 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4751e-05 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324777+0000", 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9290000000000003e-06 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324814+0000", 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6508999999999999e-05 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324821+0000", 2024-09-18T10:31:29.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6899999999999992e-06 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326198+0000", 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013770010000000001 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326213+0000", 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4136e-05 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 39/33 ECSubWrite(tid=62, reqid=client.4589.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=39'13))", 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.329569+0000", 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9348407959999996, 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056464099999999995, 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329569+0000", 2024-09-18T10:31:29.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329569+0000", 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329569+0000", 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329579+0000", 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0635999999999999e-05 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329593+0000", 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482999999999999e-05 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329598+0000", 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1669999999999998e-06 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329637+0000", 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9323999999999998e-05 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329647+0000", 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7550000000000006e-06 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.330117+0000", 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000469987 2024-09-18T10:31:29.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.330134+0000", 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6962000000000001e-05 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 40/33 ECSubWrite(tid=63, reqid=osd.13.0:63, at_version=40'15, trim_to=0'0, roll_forward_to=39'13))", 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.292523+0000", 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9718870270000002, 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017008679999999999, 2024-09-18T10:31:29.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292523+0000", 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292523+0000", 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292523+0000", 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292571+0000", 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8186000000000002e-05 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292590+0000", 2024-09-18T10:31:29.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9292000000000001e-05 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292598+0000", 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292656+0000", 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7868999999999998e-05 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292666+0000", 2024-09-18T10:31:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8789999999999998e-06 2024-09-18T10:31:29.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.294204+0000", 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015385749999999999 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.294224+0000", 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9938000000000001e-05 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=7, reqid=osd.14.0:7, at_version=40'6, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9706253810000001, 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024793150000000002, 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293784+0000", 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293834+0000", 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9882000000000001e-05 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293848+0000", 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3913e-05 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293857+0000", 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293910+0000", 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2933999999999998e-05 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293919+0000", 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3440000000000007e-06 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296229+0000", 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023091040000000002 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296264+0000", 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5673999999999998e-05 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 40/33 ECSubWrite(tid=65, reqid=osd.13.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=40'15))", 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.965840069, 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004430000000002, 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298569+0000", 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298587+0000", 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7978999999999998e-05 2024-09-18T10:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298607+0000", 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9627e-05 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298628+0000", 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1246e-05 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298695+0000", 2024-09-18T10:31:29.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7471999999999994e-05 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298707+0000", 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1379000000000001e-05 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301022+0000", 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00231526 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301071+0000", 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9655155090000003, 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049479429999999998, 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.322 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298894+0000", 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298909+0000", 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4646e-05 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298921+0000", 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2830000000000001e-05 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298942+0000", 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0462000000000002e-05 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298993+0000", 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0968999999999999e-05 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299001+0000", 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1319999999999994e-06 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303821+0000", 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048198410000000001 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303843+0000", 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1846000000000001e-05 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.326 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:29.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:29.329 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:29.326+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:104: done (0 left) 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:105: setattr oid 40 current snap is 5 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:106: rmattr oid 21 current snap is 5 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:106: done (1 left) 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:107: read oid 44 snap -1 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:107: expect (ObjNum 43 snap 0 seq_num 43) 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:108: read oid 45 snap 4 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:108: expect (ObjNum 44 snap 0 seq_num 44) 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 17 current snap is 5 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:109: seq_num 72 ranges {278528=442368,720896=720896,1441792=49152} 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:109: writing smithi16036501-17 from 278528 to 720896 tid 1 2024-09-18T10:31:29.330 INFO:tasks.rados.rados.0.smithi160.stdout:109: writing smithi16036501-17 from 720896 to 1441792 tid 2 2024-09-18T10:31:29.331 INFO:tasks.rados.rados.0.smithi160.stdout:109: writing smithi16036501-17 from 1441792 to 1490944 tid 3 2024-09-18T10:31:29.331 INFO:tasks.rados.rados.0.smithi160.stdout:110: rollback oid 46 current snap is 5 2024-09-18T10:31:29.331 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 46 to 4 2024-09-18T10:31:29.331 INFO:tasks.rados.rados.0.smithi160.stdout:108: expect (ObjNum 44 snap 0 seq_num 44) 2024-09-18T10:31:29.352 INFO:tasks.rados.rados.0.smithi160.stdout:107: expect (ObjNum 43 snap 0 seq_num 43) 2024-09-18T10:31:29.371 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 40 v 22 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:110: finishing rollback tid 1 to smithi16036501-46 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 46 v 17 (ObjNum 129 snap 0 seq_num 1066418531) dirty dne 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:105: done (4 left) 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:107: done (3 left) 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:108: done (2 left) 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:110: done (1 left) 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:111: snap_create 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:109: finishing write tid 1 to smithi16036501-17 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:109: finishing write tid 2 to smithi16036501-17 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:109: finishing write tid 3 to smithi16036501-17 2024-09-18T10:31:29.372 INFO:tasks.rados.rados.0.smithi160.stdout:109: finishing write tid 4 to smithi16036501-17 2024-09-18T10:31:29.373 INFO:tasks.rados.rados.0.smithi160.stdout:109: finishing write tid 5 to smithi16036501-17 2024-09-18T10:31:29.373 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 23 (ObjNum 72 snap 5 seq_num 72) dirty exists 2024-09-18T10:31:29.373 INFO:tasks.rados.rados.0.smithi160.stdout:109: left oid 17 (ObjNum 72 snap 5 seq_num 72) 2024-09-18T10:31:29.428 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:29.427+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:29.466 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.466 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:29.466 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:29.466 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:29.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:29.558 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:29.557+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:29.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:29.630 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:29.629+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:29.731 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:29.730+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:29.759 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 38/33 ECSubWrite(tid=27, reqid=client.4589.0:195, at_version=38'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.4866516240000003, 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001667527, 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271061+0000", 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271143+0000", 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2144000000000005e-05 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271160+0000", 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7187e-05 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271167+0000", 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3830000000000003e-06 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271224+0000", 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6783999999999997e-05 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271236+0000", 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1496e-05 2024-09-18T10:31:29.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272705+0000", 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001469637 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272729+0000", 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3264e-05 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 38/33 ECSubWrite(tid=28, reqid=client.4589.0:195, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.273563+0000", 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.4841499300000001, 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017263059999999999, 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273563+0000", 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273563+0000", 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273562+0000", 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273571+0000", 2024-09-18T10:31:29.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-06 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273581+0000", 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0886e-05 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273586+0000", 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5249999999999999e-06 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273628+0000", 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2497000000000003e-05 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273638+0000", 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5810000000000003e-06 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275264+0000", 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016264090000000001 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275289+0000", 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4678999999999999e-05 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:204 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.269997+0000", 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4877152589999998, 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071129189999999997, 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.769 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 204 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.269997+0000", 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.269997+0000", 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.269996+0000", 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270006+0000", 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0429e-05 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270023+0000", 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7356000000000001e-05 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270030+0000", 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4570000000000002e-06 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270084+0000", 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4651000000000002e-05 2024-09-18T10:31:29.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270092+0000", 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274309+0000", 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042174420000000001 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274367+0000", 2024-09-18T10:31:29.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7979000000000002e-05 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.277110+0000", 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027430319999999998 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:205 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4876699489999998, 2024-09-18T10:31:29.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076111369999999996, 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 205 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270042+0000", 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270046+0000", 2024-09-18T10:31:29.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4120000000000001e-06 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270052+0000", 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6279999999999999e-06 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270056+0000", 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3749999999999999e-06 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270134+0000", 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8008000000000003e-05 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270137+0000", 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.574e-06 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274639+0000", 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045012020000000002 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274720+0000", 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1095999999999997e-05 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.277654+0000", 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029342470000000001 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.779 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:206 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4876390920000002, 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081552699999999992, 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270073+0000", 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270076+0000", 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1389999999999999e-06 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270082+0000", 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8329999999999999e-06 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270087+0000", 2024-09-18T10:31:29.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7589999999999997e-06 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270158+0000", 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1110000000000002e-05 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270163+0000", 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1370000000000001e-06 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275879+0000", 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005716133 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275935+0000", 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5587999999999997e-05 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.278229+0000", 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022939829999999999 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.784 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.279579+0000", 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4781340160000003, 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046182239999999998, 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279579+0000", 2024-09-18T10:31:29.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279579+0000", 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279578+0000", 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280453+0000", 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087439799999999997 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280490+0000", 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7079000000000002e-05 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280497+0000", 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9890000000000003e-06 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280548+0000", 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0942000000000001e-05 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280557+0000", 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9360000000000005e-06 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284141+0000", 2024-09-18T10:31:29.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035845130000000001 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284197+0000", 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5599000000000001e-05 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 39/33 ECSubWrite(tid=30, reqid=client.4589.0:208, at_version=39'20, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.281344+0000", 2024-09-18T10:31:29.789 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4763682879999998, 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032424480000000002, 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281344+0000", 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281344+0000", 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281344+0000", 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281639+0000", 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029535100000000001 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281653+0000", 2024-09-18T10:31:29.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.361e-05 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281660+0000", 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5109999999999997e-06 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281702+0000", 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1659000000000002e-05 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281711+0000", 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5359999999999998e-06 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284565+0000", 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028540340000000001 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284587+0000", 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1501e-05 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 39/33 ECSubWrite(tid=59, reqid=client.4589.0:219, at_version=39'11, trim_to=0'0, roll_forward_to=36'9))", 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322980+0000", 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4347330730000003, 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035548329999999999, 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322980+0000", 2024-09-18T10:31:29.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322980+0000", 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322979+0000", 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322999+0000", 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9587000000000001e-05 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323041+0000", 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2141999999999997e-05 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323046+0000", 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2299999999999999e-06 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323092+0000", 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5874999999999997e-05 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323101+0000", 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0799999999999995e-06 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326505+0000", 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034043530000000002 2024-09-18T10:31:29.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326534+0000", 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9252e-05 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 39/33 ECSubWrite(tid=35, reqid=client.4589.0:223, at_version=39'24, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.324057+0000", 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4336561899999998, 2024-09-18T10:31:29.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051667889999999998, 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324057+0000", 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324057+0000", 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324056+0000", 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324079+0000", 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3475000000000001e-05 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324093+0000", 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3940999999999999e-05 2024-09-18T10:31:29.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324099+0000", 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.144e-06 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324158+0000", 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8318e-05 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324174+0000", 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5928999999999999e-05 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329203+0000", 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005029225 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329223+0000", 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0483999999999999e-05 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 39/33 ECSubWrite(tid=60, reqid=client.4589.0:220, at_version=39'12, trim_to=0'0, roll_forward_to=36'9))", 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.324083+0000", 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4336295000000003, 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051568949999999999, 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324083+0000", 2024-09-18T10:31:29.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324083+0000", 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324082+0000", 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324109+0000", 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6342999999999998e-05 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324120+0000", 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0896999999999999e-05 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324126+0000", 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.993e-06 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324170+0000", 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3943999999999998e-05 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324179+0000", 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9700000000000005e-06 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329218+0000", 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050389229999999998 2024-09-18T10:31:29.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329240+0000", 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2546000000000001e-05 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 39/33 ECSubWrite(tid=61, reqid=client.4589.0:221, at_version=39'13, trim_to=0'0, roll_forward_to=36'9))", 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.324781+0000", 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4329316900000002, 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044750859999999996, 2024-09-18T10:31:29.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324781+0000", 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324781+0000", 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324780+0000", 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324804+0000", 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3975e-05 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324823+0000", 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8147000000000001e-05 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324829+0000", 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0310000000000004e-06 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324872+0000", 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3158999999999998e-05 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324888+0000", 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6424999999999999e-05 2024-09-18T10:31:29.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329245+0000", 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043564759999999998 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329256+0000", 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1511e-05 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 39/33 ECSubWrite(tid=36, reqid=client.4589.0:224, at_version=39'25, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.324852+0000", 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4328608699999998, 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044172339999999999, 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324852+0000", 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324852+0000", 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324851+0000", 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324867+0000", 2024-09-18T10:31:29.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5916000000000001e-05 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324878+0000", 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1293e-05 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324897+0000", 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8318e-05 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324937+0000", 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0212000000000001e-05 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324945+0000", 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.208e-06 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329250+0000", 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043050919999999999 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329269+0000", 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8834999999999998e-05 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 39/33 ECSubWrite(tid=62, reqid=client.4589.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=39'13))", 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.329581+0000", 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.42813196, 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021806429999999999, 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329581+0000", 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329581+0000", 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329580+0000", 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329591+0000", 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0448999999999999e-05 2024-09-18T10:31:29.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329614+0000", 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3558999999999999e-05 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329621+0000", 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8950000000000001e-06 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329655+0000", 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4236000000000002e-05 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329663+0000", 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9570000000000002e-06 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.331742+0000", 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020788009999999999 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.331761+0000", 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9366000000000001e-05 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 39/33 ECSubWrite(tid=37, reqid=client.4589.0:224, at_version=0'0, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.329783+0000", 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4279298200000001, 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027484720000000001, 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329783+0000", 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329783+0000", 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329782+0000", 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329792+0000", 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0054000000000001e-05 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329803+0000", 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0900999999999999e-05 2024-09-18T10:31:29.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329809+0000", 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6720000000000001e-06 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329845+0000", 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6457e-05 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329854+0000", 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5189999999999992e-06 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.332514+0000", 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026597090000000001 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.332531+0000", 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7728999999999999e-05 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 40/33 ECSubWrite(tid=63, reqid=osd.13.0:63, at_version=40'15, trim_to=0'0, roll_forward_to=39'13))", 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.292577+0000", 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4651361429999996, 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019829280000000001, 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292577+0000", 2024-09-18T10:31:29.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292577+0000", 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292576+0000", 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292627+0000", 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1311999999999999e-05 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292657+0000", 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9346999999999999e-05 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292667+0000", 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0081000000000001e-05 2024-09-18T10:31:29.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292738+0000", 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0878999999999997e-05 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.292748+0000", 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0084999999999999e-05 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.294536+0000", 2024-09-18T10:31:29.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017886340000000001 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.294559+0000", 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3008999999999999e-05 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 40/33 ECSubWrite(tid=39, reqid=osd.0.0:39, at_version=40'29, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.296244+0000", 2024-09-18T10:31:29.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4614685310000004, 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001772874, 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296244+0000", 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296244+0000", 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296243+0000", 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296270+0000", 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6987000000000001e-05 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296284+0000", 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3352e-05 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296291+0000", 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1559999999999998e-06 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296336+0000", 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956999999999997e-05 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296345+0000", 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4020000000000008e-06 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.297994+0000", 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016490649999999999 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298017+0000", 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2861999999999999e-05 2024-09-18T10:31:29.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 40/33 ECSubWrite(tid=65, reqid=osd.13.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=40'15))", 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298588+0000", 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4591243089999999, 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023164710000000001, 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298588+0000", 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298588+0000", 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298588+0000", 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298599+0000", 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1735e-05 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298613+0000", 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3701e-05 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298619+0000", 2024-09-18T10:31:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4180000000000002e-06 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298687+0000", 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7490999999999995e-05 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298697+0000", 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0332e-05 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.300876+0000", 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021788910000000001 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.300905+0000", 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8682000000000001e-05 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s4 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298925+0000", 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4587875749999997, 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024625670000000001, 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298925+0000", 2024-09-18T10:31:29.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298925+0000", 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298924+0000", 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298938+0000", 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4236999999999999e-05 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298959+0000", 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0869999999999998e-05 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298967+0000", 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1249999999999993e-06 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299026+0000", 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042999999999997e-05 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299045+0000", 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-09-18T10:31:29.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301361+0000", 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002315906 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301388+0000", 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7055000000000001e-05 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 44/33 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=44'37, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.312315+0000", 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.44539819899999999, 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017151619999999999, 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312315+0000", 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312315+0000", 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312314+0000", 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312333+0000", 2024-09-18T10:31:29.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.88e-05 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312344+0000", 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1253999999999999e-05 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312352+0000", 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0949999999999996e-06 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312412+0000", 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9160000000000003e-05 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312417+0000", 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.733e-06 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314009+0000", 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001591241 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314030+0000", 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1123000000000001e-05 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 44/33 ECSubWrite(tid=48, reqid=osd.0.0:48, at_version=44'41, trim_to=0'0, roll_forward_to=44'39))", 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.327507+0000", 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.43020603099999999, 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023869429999999999, 2024-09-18T10:31:29.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327507+0000", 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327507+0000", 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327506+0000", 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327522+0000", 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6515e-05 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327531+0000", 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4880000000000007e-06 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327535+0000", 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8850000000000001e-06 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327571+0000", 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5725000000000001e-05 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327579+0000", 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8370000000000003e-06 2024-09-18T10:31:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329872+0000", 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022929909999999999 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329894+0000", 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1251999999999999e-05 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:29.854 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:29.855 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:29.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:29.857 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:29.855+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:29.956 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:29.955+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:29.994 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:29.994 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:29.995 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:29.995 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:30.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:30.057 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:30.056+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:30.099 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:30.100 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:30.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:30.159 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:30.157+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:30.207 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:30.207 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:30.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:30.207 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:30.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 38/33 ECSubWrite(tid=27, reqid=client.4589.0:195, at_version=38'17, trim_to=0'0, roll_forward_to=36'15))", 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.271092+0000", 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.9342509549999995, 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013050329999999999, 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271092+0000", 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271092+0000", 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271091+0000", 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271234+0000", 2024-09-18T10:31:30.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271249+0000", 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5441e-05 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271283+0000", 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3642000000000001e-05 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271334+0000", 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1518999999999999e-05 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.271344+0000", 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5130000000000002e-06 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272371+0000", 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001027476 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.272397+0000", 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5530000000000001e-05 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 38/33 ECSubWrite(tid=28, reqid=client.4589.0:195, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:30.212 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.9317943849999999, 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00174631, 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273548+0000", 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273557+0000", 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7579999999999998e-06 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273565+0000", 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7180000000000002e-06 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273572+0000", 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9360000000000002e-06 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273604+0000", 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1489000000000003e-05 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.273612+0000", 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0579999999999998e-06 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275276+0000", 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001663812 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275295+0000", 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9181000000000002e-05 2024-09-18T10:31:30.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.9257105130000003, 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002559342, 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280419+0000", 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078655700000000001 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280432+0000", 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2958e-05 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280439+0000", 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1930000000000004e-06 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280487+0000", 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7725000000000001e-05 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280495+0000", 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9109999999999993e-06 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.282168+0000", 2024-09-18T10:31:30.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016732850000000001 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.282192+0000", 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3839e-05 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=30, reqid=client.4589.0:208, at_version=39'20, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:30.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.9238891599999999, 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003011279, 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281453+0000", 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281781+0000", 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032834699999999999 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281791+0000", 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1910000000000006e-06 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281795+0000", 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1470000000000003e-06 2024-09-18T10:31:30.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281830+0000", 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5163999999999997e-05 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281849+0000", 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9228e-05 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284446+0000", 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025973480000000002 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284465+0000", 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8488999999999999e-05 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.228 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=31, reqid=client.4589.0:209, at_version=39'21, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.284113+0000", 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.9212300359999999, 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092986299999999996, 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284113+0000", 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284113+0000", 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284112+0000", 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284131+0000", 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9145000000000001e-05 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284142+0000", 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0206e-05 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284148+0000", 2024-09-18T10:31:30.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0190000000000003e-06 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284199+0000", 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1762999999999999e-05 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284207+0000", 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5510000000000002e-06 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.285022+0000", 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081487900000000002 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.285043+0000", 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0925999999999999e-05 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=32, reqid=client.4589.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:30.233 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.287496+0000", 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.9178473279999997, 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069433500000000003, 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287496+0000", 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287496+0000", 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287495+0000", 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287507+0000", 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2146e-05 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287522+0000", 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.491e-05 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287528+0000", 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5749999999999997e-06 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287570+0000", 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1711000000000001e-05 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.287578+0000", 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2339999999999994e-06 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.288174+0000", 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059557999999999996 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.288190+0000", 2024-09-18T10:31:30.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5829999999999999e-05 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=34, reqid=client.4589.0:222, at_version=39'23, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322909+0000", 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.8824338919999999, 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001037561, 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322909+0000", 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322909+0000", 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322908+0000", 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322938+0000", 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9848e-05 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322956+0000", 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7867e-05 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322964+0000", 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8990000000000007e-06 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323016+0000", 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1570999999999998e-05 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323026+0000", 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0030999999999999e-05 2024-09-18T10:31:30.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323925+0000", 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00089919999999999996 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323947+0000", 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1234e-05 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=36, reqid=client.4589.0:224, at_version=39'25, trim_to=0'0, roll_forward_to=39'21))", 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.324907+0000", 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.880436016, 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060530800000000004, 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324907+0000", 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324907+0000", 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324906+0000", 2024-09-18T10:31:30.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324922+0000", 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6103000000000002e-05 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324937+0000", 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5109000000000001e-05 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324944+0000", 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0539999999999997e-06 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324986+0000", 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1674000000000001e-05 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324995+0000", 2024-09-18T10:31:30.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4409999999999993e-06 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.325492+0000", 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049741900000000003 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.325512+0000", 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0199000000000001e-05 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/33 ECSubWrite(tid=38, reqid=osd.0.0:38, at_version=40'27, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.293802+0000", 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9115407659999999, 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001901975, 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293802+0000", 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293802+0000", 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293802+0000", 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293823+0000", 2024-09-18T10:31:30.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1549e-05 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293835+0000", 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1382e-05 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293861+0000", 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6168000000000001e-05 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293959+0000", 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7664000000000005e-05 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293969+0000", 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0446e-05 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.295676+0000", 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170714 2024-09-18T10:31:30.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.295704+0000", 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7915e-05 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/33 ECSubWrite(tid=39, reqid=osd.0.0:39, at_version=40'29, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.296272+0000", 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9090707299999998, 2024-09-18T10:31:30.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012546739999999999, 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296272+0000", 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296272+0000", 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296271+0000", 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296298+0000", 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6775999999999999e-05 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296312+0000", 2024-09-18T10:31:30.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4579000000000001e-05 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296320+0000", 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7340000000000008e-06 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296391+0000", 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0525999999999995e-05 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296400+0000", 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7140000000000005e-06 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.297497+0000", 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001096589 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.297527+0000", 2024-09-18T10:31:30.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9821000000000001e-05 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/33 ECSubWrite(tid=40, reqid=osd.0.0:39, at_version=0'0, trim_to=0'0, roll_forward_to=40'29))", 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.304166+0000", 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9011763550000005, 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060889799999999997, 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304166+0000", 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304166+0000", 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304166+0000", 2024-09-18T10:31:30.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304186+0000", 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0296999999999999e-05 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304199+0000", 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3406e-05 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304205+0000", 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7200000000000003e-06 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304252+0000", 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7067999999999997e-05 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304262+0000", 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5310000000000007e-06 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304749+0000", 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048727599999999997 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.304775+0000", 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.635e-05 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 44/33 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=44'37, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.312415+0000", 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.89292793699999995, 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001069874, 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312415+0000", 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312415+0000", 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312415+0000", 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312431+0000", 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6189999999999999e-05 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312439+0000", 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6690000000000006e-06 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312443+0000", 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6240000000000001e-06 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312495+0000", 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2095999999999997e-05 2024-09-18T10:31:30.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.312506+0000", 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0943e-05 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313469+0000", 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096280200000000002 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313485+0000", 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5684000000000001e-05 2024-09-18T10:31:30.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.89226662099999998, 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001542236, 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313075+0000", 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313106+0000", 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0632000000000001e-05 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313115+0000", 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8980000000000002e-06 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313119+0000", 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1280000000000001e-06 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313156+0000", 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7092999999999999e-05 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.313166+0000", 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0158e-05 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314601+0000", 2024-09-18T10:31:30.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001434643 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314618+0000", 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7472000000000001e-05 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 44/33 ECSubWrite(tid=28, reqid=osd.3.0:28, at_version=44'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.314180+0000", 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.891162703, 2024-09-18T10:31:30.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081949099999999999, 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314180+0000", 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314180+0000", 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314180+0000", 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314194+0000", 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4399000000000001e-05 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314202+0000", 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6890000000000004e-06 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314208+0000", 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6670000000000001e-06 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314248+0000", 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0126000000000002e-05 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314257+0000", 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9700000000000005e-06 2024-09-18T10:31:30.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.314975+0000", 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071845500000000001 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.315000+0000", 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4406999999999999e-05 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 44/33 ECSubWrite(tid=47, reqid=osd.0.0:46, at_version=0'0, trim_to=0'0, roll_forward_to=44'39))", 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.326014+0000", 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.87932913499999998, 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001325608, 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326014+0000", 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326014+0000", 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326013+0000", 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326024+0000", 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1351e-05 2024-09-18T10:31:30.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326043+0000", 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8306000000000001e-05 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326051+0000", 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0730000000000005e-06 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326123+0000", 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2249000000000006e-05 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.326133+0000", 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0105999999999999e-05 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327316+0000", 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011823960000000001 2024-09-18T10:31:30.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327339+0000", 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3781000000000002e-05 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 44/33 ECSubWrite(tid=48, reqid=osd.0.0:48, at_version=44'41, trim_to=0'0, roll_forward_to=44'39))", 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.327757+0000", 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.87758542399999995, 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075091299999999997, 2024-09-18T10:31:30.279 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327757+0000", 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327757+0000", 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327757+0000", 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327783+0000", 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6163e-05 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327794+0000", 2024-09-18T10:31:30.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1508000000000001e-05 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327800+0000", 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6289999999999998e-06 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327836+0000", 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5868000000000003e-05 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.327842+0000", 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2600000000000002e-06 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328487+0000", 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064494499999999996 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328508+0000", 2024-09-18T10:31:30.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1185000000000001e-05 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 44/33 ECSubWrite(tid=30, reqid=client.4589.0:285, at_version=44'20, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.329232+0000", 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.87611059000000002, 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001763024, 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329232+0000", 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329232+0000", 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329232+0000", 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329534+0000", 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030253700000000002 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329544+0000", 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8649999999999996e-06 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329549+0000", 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7729999999999999e-06 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329577+0000", 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8663999999999999e-05 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.329584+0000", 2024-09-18T10:31:30.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7519999999999999e-06 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.330975+0000", 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00139123 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.330995+0000", 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9817e-05 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 44/33 ECSubWrite(tid=31, reqid=client.4589.0:286, at_version=44'21, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.332139+0000", 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.87320399699999995, 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001073573, 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332139+0000", 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332139+0000", 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332138+0000", 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332416+0000", 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027759699999999998 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332426+0000", 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0581000000000001e-05 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332431+0000", 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7790000000000003e-06 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332464+0000", 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3105000000000002e-05 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332473+0000", 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8710000000000003e-06 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333186+0000", 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071325999999999996 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333212+0000", 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6012000000000001e-05 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 44/33 ECSubWrite(tid=49, reqid=osd.0.0:48, at_version=0'0, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.332802+0000", 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.87254066200000002, 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066518600000000001, 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332802+0000", 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332802+0000", 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332802+0000", 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332811+0000", 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2750000000000001e-06 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332820+0000", 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1390000000000001e-06 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332824+0000", 2024-09-18T10:31:30.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4050000000000002e-06 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332859+0000", 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4366000000000003e-05 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.332864+0000", 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.113e-06 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333448+0000", 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058366899999999998 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333467+0000", 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9813000000000002e-05 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 44/33 ECSubWrite(tid=32, reqid=client.4589.0:287, at_version=44'22, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.333643+0000", 2024-09-18T10:31:30.298 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.87169935099999996, 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001515953, 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333643+0000", 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333643+0000", 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333643+0000", 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333669+0000", 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5692999999999999e-05 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333678+0000", 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333682+0000", 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1880000000000004e-06 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333716+0000", 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4276999999999997e-05 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.333722+0000", 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.93e-06 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.335141+0000", 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001418157 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.335159+0000", 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8941999999999999e-05 2024-09-18T10:31:30.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.303 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:30.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:30.305 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:30.303+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:30.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:109: done (1 left) 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:111: done (0 left) 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:112: read oid 42 snap 3 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:112: expect (ObjNum 61 snap 2 seq_num 61) 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:113: copy_from oid 40 from oid 43 current snap is 6 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 26 current snap is 6 2024-09-18T10:31:30.311 INFO:tasks.rados.rados.0.smithi160.stdout:114: seq_num 73 ranges {1409024=458752,1867776=475136,2342912=294912} 2024-09-18T10:31:30.321 INFO:tasks.rados.rados.0.smithi160.stdout:114: writing smithi16036501-26 from 1409024 to 1867776 tid 1 2024-09-18T10:31:30.324 INFO:tasks.rados.rados.0.smithi160.stdout:114: writing smithi16036501-26 from 1867776 to 2342912 tid 2 2024-09-18T10:31:30.326 INFO:tasks.rados.rados.0.smithi160.stdout:114: writing smithi16036501-26 from 2342912 to 2637824 tid 3 2024-09-18T10:31:30.326 INFO:tasks.rados.rados.0.smithi160.stdout:115: copy_from oid 20 from oid 50 current snap is 6 2024-09-18T10:31:30.326 INFO:tasks.rados.rados.0.smithi160.stdout:116: read oid 16 snap 3 2024-09-18T10:31:30.326 INFO:tasks.rados.rados.0.smithi160.stdout:116: expect (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:31:30.327 INFO:tasks.rados.rados.0.smithi160.stdout:117: read oid 13 snap -1 2024-09-18T10:31:30.327 INFO:tasks.rados.rados.0.smithi160.stdout:117: expect (ObjNum 62 snap 3 seq_num 62) 2024-09-18T10:31:30.327 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 37 current snap is 6 2024-09-18T10:31:30.327 INFO:tasks.rados.rados.0.smithi160.stdout:118: seq_num 74 ranges {606208=475136,1081344=622592,1703936=147456} 2024-09-18T10:31:30.333 INFO:tasks.rados.rados.0.smithi160.stdout:118: writing smithi16036501-37 from 606208 to 1081344 tid 1 2024-09-18T10:31:30.336 INFO:tasks.rados.rados.0.smithi160.stdout:118: writing smithi16036501-37 from 1081344 to 1703936 tid 2 2024-09-18T10:31:30.337 INFO:tasks.rados.rados.0.smithi160.stdout:118: writing smithi16036501-37 from 1703936 to 1851392 tid 3 2024-09-18T10:31:30.337 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 24 current snap is 6 2024-09-18T10:31:30.338 INFO:tasks.rados.rados.0.smithi160.stdout:112: expect (ObjNum 61 snap 2 seq_num 61) 2024-09-18T10:31:30.378 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:30.396 INFO:tasks.rados.rados.0.smithi160.stdout:113: finishing copy_from racing read to smithi16036501-40 2024-09-18T10:31:30.396 INFO:tasks.rados.rados.0.smithi160.stdout:113: finishing copy_from to smithi16036501-40 2024-09-18T10:31:30.396 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 40 v 12 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-18T10:31:30.396 INFO:tasks.rados.rados.0.smithi160.stdout:114: finishing write tid 1 to smithi16036501-26 2024-09-18T10:31:30.396 INFO:tasks.rados.rados.0.smithi160.stdout:119: seq_num 75 ranges {0=491520,491520=770048} 2024-09-18T10:31:30.398 INFO:tasks.rados.rados.0.smithi160.stdout:119: writing smithi16036501-24 from 0 to 491520 tid 1 2024-09-18T10:31:30.403 INFO:tasks.rados.rados.0.smithi160.stdout:119: writing smithi16036501-24 from 491520 to 1261568 tid 2 2024-09-18T10:31:30.403 INFO:tasks.rados.rados.0.smithi160.stdout:112: done (7 left) 2024-09-18T10:31:30.403 INFO:tasks.rados.rados.0.smithi160.stdout:113: done (6 left) 2024-09-18T10:31:30.403 INFO:tasks.rados.rados.0.smithi160.stdout:120: snap_create 2024-09-18T10:31:30.404 INFO:tasks.rados.rados.0.smithi160.stdout:114: finishing write tid 2 to smithi16036501-26 2024-09-18T10:31:30.404 INFO:tasks.rados.rados.0.smithi160.stdout:114: finishing write tid 3 to smithi16036501-26 2024-09-18T10:31:30.404 INFO:tasks.rados.rados.0.smithi160.stdout:114: finishing write tid 4 to smithi16036501-26 2024-09-18T10:31:30.404 INFO:tasks.rados.rados.0.smithi160.stdout:116: expect (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:31:30.405 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:30.404+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:30.408 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:30.408 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:30.408 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:30.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:30.442 INFO:tasks.rados.rados.0.smithi160.stdout:115: finishing copy_from racing read to smithi16036501-20 2024-09-18T10:31:30.442 INFO:tasks.rados.rados.0.smithi160.stdout:118: finishing write tid 1 to smithi16036501-37 2024-09-18T10:31:30.442 INFO:tasks.rados.rados.0.smithi160.stdout:117: expect (ObjNum 62 snap 3 seq_num 62) 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:114: finishing write tid 5 to smithi16036501-26 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 26 v 46 (ObjNum 73 snap 6 seq_num 73) dirty exists 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:114: left oid 26 (ObjNum 73 snap 6 seq_num 73) 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:115: finishing copy_from to smithi16036501-20 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 20 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:118: finishing write tid 2 to smithi16036501-37 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:118: finishing write tid 3 to smithi16036501-37 2024-09-18T10:31:30.479 INFO:tasks.rados.rados.0.smithi160.stdout:118: finishing write tid 4 to smithi16036501-37 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:118: finishing write tid 5 to smithi16036501-37 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 35 (ObjNum 74 snap 6 seq_num 74) dirty exists 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:118: left oid 37 (ObjNum 74 snap 6 seq_num 74) 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:119: finishing write tid 1 to smithi16036501-24 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:119: finishing write tid 2 to smithi16036501-24 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:119: finishing write tid 3 to smithi16036501-24 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:119: finishing write tid 4 to smithi16036501-24 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 24 v 27 (ObjNum 75 snap 6 seq_num 75) dirty exists 2024-09-18T10:31:30.480 INFO:tasks.rados.rados.0.smithi160.stdout:119: left oid 24 (ObjNum 75 snap 6 seq_num 75) 2024-09-18T10:31:30.506 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:30.506 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:30.506 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:30.504+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:30.514 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:30.515 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:30.515 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:30.515 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:30.515 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:30.523 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:30.523 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:30.524 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:30.539 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:30.539 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:30.555 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:30.556 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:30.586 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:30.587 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:30.608 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:30.607+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:30.612 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:30.612 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:30.628 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:30.628 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:30.643 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:30.659 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:30.663 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:30.663 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.476542414000001, 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.349076098, 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:30.664 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185093+0000", 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999952 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185102+0000", 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185111+0000", 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4130000000000006e-06 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185116+0000", 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0080000000000002e-06 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185151+0000", 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5216000000000003e-05 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185156+0000", 2024-09-18T10:31:30.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5090000000000001e-06 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534040+0000", 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.34888328099999999 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534174+0000", 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134129 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:06.178152+0000", 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.483488595000001, 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034506150000000002, 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 5 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178152+0000", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178152+0000", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178149+0000", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178163+0000", 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4081e-05 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178184+0000", 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0324999999999999e-05 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178191+0000", 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3749999999999997e-06 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178244+0000", 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2898000000000001e-05 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.178249+0000", 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0010000000000001e-06 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.179764+0000", 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015156460000000001 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.179860+0000", 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5420999999999993e-05 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.179973+0000", 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112738 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.180839+0000", 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086666599999999999 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181519+0000", 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067923799999999998 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181560+0000", 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1012e-05 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:06.181602+0000", 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2707000000000003e-05 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.476628351999999, 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010537852, 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.675 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185009+0000", 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185021+0000", 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024e-05 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185062+0000", 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0363e-05 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185072+0000", 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0712e-05 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185133+0000", 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0458999999999998e-05 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:30.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185140+0000", 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1720000000000001e-06 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190251+0000", 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051104840000000002 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190319+0000", 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8640999999999996e-05 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190422+0000", 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102576 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.191693+0000", 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012707980000000001 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195487+0000", 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003794651 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195521+0000", 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3760999999999997e-05 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195550+0000", 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742e-05 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.681 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:199 3.fs0 3:f4795e34:::smithi16036501-42:head [append 0~655360] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.3857589819999996, 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069400019999999998, 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 199 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275880+0000", 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276765+0000", 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088549699999999996 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276778+0000", 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2252999999999999e-05 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276782+0000", 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2810000000000002e-06 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276813+0000", 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1058e-05 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276874+0000", 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1088999999999997e-05 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.277608+0000", 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073422699999999995 2024-09-18T10:31:30.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280017+0000", 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024085579999999999 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282781+0000", 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027636050000000001 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282821+0000", 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0683999999999999e-05 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:200 3.fs0 3:f4795e34:::smithi16036501-42:head [append 0~376832] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.3836162029999999, 2024-09-18T10:31:30.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076441959999999998, 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 200 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278023+0000", 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278670+0000", 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064669399999999996 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278679+0000", 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4809999999999995e-06 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278683+0000", 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7900000000000001e-06 2024-09-18T10:31:30.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278710+0000", 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7151000000000001e-05 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278759+0000", 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8618000000000001e-05 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279167+0000", 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040784699999999997 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280125+0000", 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095786999999999999 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285637+0000", 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055121420000000003 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285668+0000", 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1341999999999999e-05 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:201 3.fs0 3:f4795e34:::smithi16036501-42:head [setxattr _header (56) in=7b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.3829508620000004, 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071686570000000002, 2024-09-18T10:31:30.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 201 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278692+0000", 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9440000000000001e-06 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278697+0000", 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6980000000000003e-06 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278700+0000", 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279543+0000", 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084349999999999996 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279615+0000", 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1477999999999996e-05 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279853+0000", 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238106 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280169+0000", 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031569500000000001 2024-09-18T10:31:30.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285808+0000", 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056395229999999996 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285858+0000", 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9799000000000002e-05 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.698 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:202 3.fs0 3:f4795e34:::smithi16036501-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.3829270879999997, 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081974649999999993, 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 202 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:30.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278715+0000", 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3609999999999999e-06 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278722+0000", 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5520000000000001e-06 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278725+0000", 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-06 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280064+0000", 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013385389999999999 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280120+0000", 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5856999999999997e-05 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286097+0000", 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059775230000000002 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286178+0000", 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0519999999999995e-05 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286911+0000", 2024-09-18T10:31:30.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073268499999999996 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:219 3.as0 3:5626e28a:::smithi16036501-35:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.321961+0000", 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.3396795240000001, 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047407459999999997, 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.704 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.321961+0000", 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.321961+0000", 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.321958+0000", 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999967 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.321974+0000", 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6687000000000001e-05 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322007+0000", 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3052000000000001e-05 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322020+0000", 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2853999999999999e-05 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322159+0000", 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013841099999999999 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322292+0000", 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013307600000000001 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322999+0000", 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000707286 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324910+0000", 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019112420000000001 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326666+0000", 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017559240000000001 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326701+0000", 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5330999999999998e-05 2024-09-18T10:31:30.709 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:220 3.as0 3:5626e28a:::smithi16036501-35:head [rollback 4] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322058+0000", 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.3395823829999998, 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073414489999999999, 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 220 2024-09-18T10:31:30.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322058+0000", 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322058+0000", 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322056+0000", 2024-09-18T10:31:30.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322064+0000", 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0899999999999999e-06 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322082+0000", 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8283000000000001e-05 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322088+0000", 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5300000000000002e-06 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323501+0000", 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001412684 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323568+0000", 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6996999999999996e-05 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324017+0000", 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044873500000000002 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326408+0000", 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023910630000000001 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329365+0000", 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029574699999999998 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329399+0000", 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.392e-05 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:221 3.as0 3:5626e28a:::smithi16036501-35:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.3395427160000004, 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073974669999999996, 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 221 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322103+0000", 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1430000000000003e-06 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322115+0000", 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.203e-05 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322124+0000", 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1160000000000005e-06 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324327+0000", 2024-09-18T10:31:30.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022027399999999999 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324403+0000", 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6731999999999996e-05 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324763+0000", 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000359864 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329244+0000", 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044813170000000003 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329465+0000", 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022025500000000001 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329495+0000", 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0247e-05 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s2 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298952+0000", 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.362688447, 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023526850000000002, 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298952+0000", 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298952+0000", 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298951+0000", 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298965+0000", 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4177e-05 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298979+0000", 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3720000000000001e-05 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299005+0000", 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6676999999999999e-05 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299067+0000", 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1402999999999995e-05 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299076+0000", 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3549999999999994e-06 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301281+0000", 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022052320000000001 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301304+0000", 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.313e-05 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:278 3.as0 3:597221c7:::smithi16036501-40:head [create,setxattr dj[s][nsgcdlaO`ntnnogS`sZdZO[V\\]llWi\\gjj (11296) in=40b,setxattr qRNaVOjbUaQsk\\XsiZbOhrsOSoqX_Tqndtkb\\_Sa (1297) in=40b,setxattr `hdQPrsh[aUo`rPcbh\\tWT\\PatkS^p[P_Pdmcgdi (840) in=40b,setxattr RXicf\\^UcqO_mXh^am]mfcdttd\\mfOiPqZcomOo` (1822) in=40b,setxattr oZlXqWbdtOrc_U_m[apaV_Nr[hOOUgj`sVNpq^Rp (1473) in=40b,setxattr TrdTbcloOaiWXhjih\\mdXfYZcg\\^aOrnVOj^sf`s (10104) in=40b,setxattr XftrktNgjnZekN[]^ls\\[htgSaXkUrlVOqS[WcNt (1263) in=40b,setxattr ^qaVseQnk[`qOXVa`m]]NtQ\\psXaNYand^tQYrWt (1051) in=40b,setxattr b_e\\_i^rj`csr^q^\\e_boR\\lQNhcZg_NVqpgUQ`Q (418) in=40b,setxattr cfoPTk\\o\\Qqbi^XNOW[dbpcRb`OledY]YqcmmqUr (19016) in=40b,setxattr qjofnWtf]NipeS]\\gcjdaepnS_Pi^QgbRZd (10104) in=35b,setxattr mtVO^NRpeT]rQZYdTadneUO_^VXn^UdhZ^\\bUQiR (769) in=40b,setxattr prahkiNnm`U[rXSatop\\lk_p\\WVkdatg[XURZrsm (4560) in=40b,setxattr isZNUepUtPtRnYQaXpfelSVVR\\apSohRfqcfV`T_ (10033) in=40b,setxattr QZkproN[Zssrnra[rrbkaSXpatcreQpt`tWbOdoO (8349) in=40b,setxattr YqVPkaeiY^Tbe\\Rr\\heXkWjtOsi`iaN[TO\\^kP^] (876) in=40b,setxattr ZdfcZ]]snWVj]dZhZ]YSjVneRRoNbk`d^een^nqN (3368) in=40b,setxattr Y^XWcNfadqaYlbNpPbVRoPtgWreNtPrhWlfbbYY] (10804) in=40b,setxattr a`l_j\\^WlXY[ekSUURUhO (10104) in=21b,setxattr YgOToR[hPbQocWaoh\\h_NkYaghbpdean`\\kalgQ[ (1541) in=40b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.343709069, 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010663587, 2024-09-18T10:31:30.725 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 278 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317930+0000", 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318130+0000", 2024-09-18T10:31:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020014100000000001 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318141+0000", 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1308000000000001e-05 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318146+0000", 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318184+0000", 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8597000000000003e-05 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318296+0000", 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111852 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319182+0000", 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088532300000000003 2024-09-18T10:31:30.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.321095+0000", 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001913131 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328552+0000", 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074568689999999997 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328595+0000", 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3090999999999998e-05 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:292 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35085784199999998, 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010659095, 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:30.731 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 292 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310780+0000", 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310799+0000", 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9327e-05 2024-09-18T10:31:30.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310820+0000", 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0859000000000001e-05 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310829+0000", 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9600000000000006e-06 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4290999999999999e-05 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310889+0000", 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1909999999999999e-06 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316357+0000", 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054682480000000002 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316408+0000", 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1192e-05 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.321441+0000", 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050333549999999998 2024-09-18T10:31:30.736 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:293 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35079959399999999, 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011301637999999999, 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 293 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:31:30.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310840+0000", 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310844+0000", 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2350000000000001e-06 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310854+0000", 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9340000000000001e-06 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310859+0000", 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9869999999999999e-06 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310943+0000", 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3727999999999995e-05 2024-09-18T10:31:30.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310949+0000", 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1800000000000001e-06 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316672+0000", 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057234160000000003 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316761+0000", 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8483e-05 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.322142+0000", 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053813089999999999 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:294 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:30.742 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35075647300000001, 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012181983, 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 294 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310886+0000", 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8210000000000002e-06 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310891+0000", 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6439999999999999e-06 2024-09-18T10:31:30.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310897+0000", 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3040000000000001e-06 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310968+0000", 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0729999999999995e-05 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310973+0000", 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.853e-06 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317866+0000", 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068931009999999996 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317931+0000", 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5177000000000003e-05 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.323066+0000", 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051347789999999999 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:295 3.as0 3:597221c7:::smithi16036501-40:head [copy-from ver 12] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35074034799999998, 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021473249999999999, 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.748 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 295 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310909+0000", 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8190000000000003e-06 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310918+0000", 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0440000000000001e-06 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310923+0000", 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0430000000000001e-06 2024-09-18T10:31:30.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310964+0000", 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1553e-05 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310971+0000", 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6320000000000002e-06 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316320+0000", 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053496139999999999 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316416+0000", 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5945000000000004e-05 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324379+0000", 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079626609999999994 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329447+0000", 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050681579999999997 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332330+0000", 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028824720000000001 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332373+0000", 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3553000000000001e-05 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:296 3.as0 3:597221c7:::smithi16036501-40:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.35070823600000001, 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01562151, 2024-09-18T10:31:30.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 296 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310934+0000", 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7549999999999999e-06 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310941+0000", 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5889999999999999e-06 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310946+0000", 2024-09-18T10:31:30.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0259999999999998e-06 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310985+0000", 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8912000000000003e-05 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310988+0000", 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3469999999999999e-06 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316561+0000", 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055726819999999998 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316612+0000", 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0776000000000003e-05 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326337+0000", 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097256470000000005 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326429+0000", 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1984999999999994e-05 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326553+0000", 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012421900000000001 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpReadReply(3.fs0 44/33 ECSubReadReply(tid=76, attrs_read=0))", 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.318600+0000", 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.34304011000000001, 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002886254, 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.318600+0000", 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.318600+0000", 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.318600+0000", 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.320551+0000", 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019514140000000001 2024-09-18T10:31:30.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.320558+0000", 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.320562+0000", 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9009999999999996e-06 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.320592+0000", 2024-09-18T10:31:30.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0488999999999999e-05 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.321486+0000", 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000894004 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.1s1 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.340355+0000", 2024-09-18T10:31:30.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.32128569699999998, 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029638860000000002, 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.340355+0000", 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.340355+0000", 2024-09-18T10:31:30.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.340354+0000", 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.341193+0000", 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00083939799999999999 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.341207+0000", 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3923e-05 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.341215+0000", 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6969999999999993e-06 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.341256+0000", 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1016000000000002e-05 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.341262+0000", 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4400000000000002e-06 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343293+0000", 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002030918 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343318+0000", 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289000000000001e-05 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.7s6 45/33 ECSubWrite(tid=132, reqid=client.4589.0:311, at_version=45'33, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.343291+0000", 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.31834901199999999, 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002545004, 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343291+0000", 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343291+0000", 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343291+0000", 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343828+0000", 2024-09-18T10:31:30.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053786600000000002 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343837+0000", 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0939999999999997e-06 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343842+0000", 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2019999999999997e-06 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:30.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343879+0000", 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6903999999999998e-05 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.343885+0000", 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.122e-06 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.345814+0000", 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019290150000000001 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:30.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.345836+0000", 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2455000000000001e-05 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:30.774 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:30.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:30.776 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:30.774+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:30.776 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:30.777 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:30.777 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:30.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:30.778 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:30.778 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:30.779 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:30.779 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:30.877 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:30.876+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:30.888 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:30.888 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:30.891 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:30.891 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T10:31:30.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:30.940 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:30.940 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:30.956 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:30.956 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:30.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:30.955+0000 7ff8df59e640 0 -- 172.21.15.63:0/2667953196 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7ff8e0195d10 msgr2=0x7ff8e01980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:30.977 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:30.977+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:30.997 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:30.997 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:31.078 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:31.077+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:31.144 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.144 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:31.172 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:31.196 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:31.195+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:31.250 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.250 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:31.280 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:31.280+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:31.321 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-18T10:31:31.321 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T10:31:31.322 INFO:tasks.rados.rados.0.smithi160.stdout:114: done (6 left) 2024-09-18T10:31:31.322 INFO:tasks.rados.rados.0.smithi160.stdout:115: done (5 left) 2024-09-18T10:31:31.322 INFO:tasks.rados.rados.0.smithi160.stdout:116: done (4 left) 2024-09-18T10:31:31.322 INFO:tasks.rados.rados.0.smithi160.stdout:117: done (3 left) 2024-09-18T10:31:31.322 INFO:tasks.rados.rados.0.smithi160.stdout:118: done (2 left) 2024-09-18T10:31:31.323 INFO:tasks.rados.rados.0.smithi160.stdout:119: done (1 left) 2024-09-18T10:31:31.323 INFO:tasks.rados.rados.0.smithi160.stdout:120: done (0 left) 2024-09-18T10:31:31.323 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 36 current snap is 7 2024-09-18T10:31:31.323 INFO:tasks.rados.rados.0.smithi160.stdout:121: seq_num 76 ranges {589824=507904,1097728=507904,1605632=262144} 2024-09-18T10:31:31.327 INFO:tasks.rados.rados.0.smithi160.stdout:121: writing smithi16036501-36 from 589824 to 1097728 tid 1 2024-09-18T10:31:31.332 INFO:tasks.rados.rados.0.smithi160.stdout:121: writing smithi16036501-36 from 1097728 to 1605632 tid 2 2024-09-18T10:31:31.332 INFO:tasks.rados.rados.0.smithi160.stdout:121: writing smithi16036501-36 from 1605632 to 1867776 tid 3 2024-09-18T10:31:31.332 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 19 current snap is 7 2024-09-18T10:31:31.332 INFO:tasks.rados.rados.0.smithi160.stdout:122: seq_num 77 ranges {1179648=524288,1703936=524288,2228224=245760} 2024-09-18T10:31:31.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T10:31:31.341 INFO:tasks.rados.rados.0.smithi160.stdout:122: writing smithi16036501-19 from 1179648 to 1703936 tid 1 2024-09-18T10:31:31.344 INFO:tasks.rados.rados.0.smithi160.stdout:122: writing smithi16036501-19 from 1703936 to 2228224 tid 2 2024-09-18T10:31:31.347 INFO:tasks.rados.rados.0.smithi160.stdout:122: writing smithi16036501-19 from 2228224 to 2473984 tid 3 2024-09-18T10:31:31.347 INFO:tasks.rados.rados.0.smithi160.stdout:123: copy_from oid 37 from oid 43 current snap is 7 2024-09-18T10:31:31.347 INFO:tasks.rados.rados.0.smithi160.stdout:121: finishing write tid 1 to smithi16036501-36 2024-09-18T10:31:31.347 INFO:tasks.rados.rados.0.smithi160.stdout:121: finishing write tid 2 to smithi16036501-36 2024-09-18T10:31:31.347 INFO:tasks.rados.rados.0.smithi160.stdout:121: finishing write tid 3 to smithi16036501-36 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:121: finishing write tid 4 to smithi16036501-36 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:121: finishing write tid 5 to smithi16036501-36 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 36 v 29 (ObjNum 76 snap 7 seq_num 76) dirty exists 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:121: left oid 36 (ObjNum 76 snap 7 seq_num 76) 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:121: done (2 left) 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:124: copy_from oid 26 from oid 34 current snap is 7 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:125: copy_from oid 22 from oid 20 current snap is 7 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:126: rollback oid 32 current snap is 7 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 32 to 5 2024-09-18T10:31:31.348 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 3 current snap is 7 2024-09-18T10:31:31.349 INFO:tasks.rados.rados.0.smithi160.stdout:127: seq_num 78 ranges {49152=557056,606208=671744,1277952=98304} 2024-09-18T10:31:31.350 INFO:tasks.rados.rados.0.smithi160.stdout:127: writing smithi16036501-3 from 49152 to 606208 tid 1 2024-09-18T10:31:31.354 INFO:tasks.rados.rados.0.smithi160.stdout:127: writing smithi16036501-3 from 606208 to 1277952 tid 2 2024-09-18T10:31:31.355 INFO:tasks.rados.rados.0.smithi160.stdout:127: writing smithi16036501-3 from 1277952 to 1376256 tid 3 2024-09-18T10:31:31.355 INFO:tasks.rados.rados.0.smithi160.stdout:128: read oid 47 snap 5 2024-09-18T10:31:31.355 INFO:tasks.rados.rados.0.smithi160.stdout:128: expect deleted 2024-09-18T10:31:31.355 INFO:tasks.rados.rados.0.smithi160.stdout:129: snap_remove snap 4 2024-09-18T10:31:31.404 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.405 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.413 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:31.420 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:31.419+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:31.481 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:31.481+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:31.510 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.510 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:31.583 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:31.582+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:31.616 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.616 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:31.683 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:31.683+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:31.721 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.721 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:31.784 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:31.783+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:31.827 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.827 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.835 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:31.885 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:31.884+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:31.975 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:31.975 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:31.983 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:31.985 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:31.984+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:32.080 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.080 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.086 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:32.085+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:32.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:32.187 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:32.186+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.235 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:32.289 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:32.288+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:129: done (7 left) 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:130: snap_create 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:124: finishing copy_from to smithi16036501-26 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:124: got expected ENOENT (src dne) 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:124: finishing copy_from racing read to smithi16036501-26 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:122: finishing write tid 1 to smithi16036501-19 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:122: finishing write tid 2 to smithi16036501-19 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:126: finishing rollback tid 0 to smithi16036501-32 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:122: finishing write tid 3 to smithi16036501-19 2024-09-18T10:31:32.325 INFO:tasks.rados.rados.0.smithi160.stdout:122: finishing write tid 4 to smithi16036501-19 2024-09-18T10:31:32.326 INFO:tasks.rados.rados.0.smithi160.stdout:126: finishing rollback tid 1 to smithi16036501-32 2024-09-18T10:31:32.326 INFO:tasks.rados.rados.0.smithi160.stdout:126: finishing rollback tid 2 to smithi16036501-32 2024-09-18T10:31:32.326 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 32 v 16 (ObjNum 67 snap 4 seq_num 67) dirty exists 2024-09-18T10:31:32.326 INFO:tasks.rados.rados.0.smithi160.stdout:122: finishing write tid 5 to smithi16036501-19 2024-09-18T10:31:32.326 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 20 (ObjNum 77 snap 7 seq_num 77) dirty exists 2024-09-18T10:31:32.326 INFO:tasks.rados.rados.0.smithi160.stdout:122: left oid 19 (ObjNum 77 snap 7 seq_num 77) 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:123: finishing copy_from racing read to smithi16036501-37 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:127: finishing write tid 1 to smithi16036501-3 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:125: finishing copy_from racing read to smithi16036501-22 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:127: finishing write tid 2 to smithi16036501-3 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:123: finishing copy_from to smithi16036501-37 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 12 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-18T10:31:32.327 INFO:tasks.rados.rados.0.smithi160.stdout:127: finishing write tid 3 to smithi16036501-3 2024-09-18T10:31:32.328 INFO:tasks.rados.rados.0.smithi160.stdout:127: finishing write tid 4 to smithi16036501-3 2024-09-18T10:31:32.328 INFO:tasks.rados.rados.0.smithi160.stdout:125: finishing copy_from to smithi16036501-22 2024-09-18T10:31:32.328 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 22 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-18T10:31:32.328 INFO:tasks.rados.rados.0.smithi160.stdout:127: finishing write tid 5 to smithi16036501-3 2024-09-18T10:31:32.328 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 3 v 12 (ObjNum 78 snap 7 seq_num 78) dirty exists 2024-09-18T10:31:32.328 INFO:tasks.rados.rados.0.smithi160.stdout:127: left oid 3 (ObjNum 78 snap 7 seq_num 78) 2024-09-18T10:31:32.329 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T10:31:32.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T10:31:32.351 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.352 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.361 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:32.404 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:32.403+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:32.460 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.460 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.468 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:32.509 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:32.508+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:32.584 INFO:tasks.rados.rados.0.smithi160.stdout:122: done (7 left) 2024-09-18T10:31:32.584 INFO:tasks.rados.rados.0.smithi160.stdout:123: done (6 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:124: done (5 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:125: done (4 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:126: done (3 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:127: done (2 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:128: done (1 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:130: done (0 left) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:131: copy_from oid 7 from oid 16 current snap is 8 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:132: read oid 20 snap -1 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:132: expect (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:31:32.585 INFO:tasks.rados.rados.0.smithi160.stdout:133: delete oid 46 current snap is 8 2024-09-18T10:31:32.591 INFO:tasks.rados.rados.0.smithi160.stdout:132: expect (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:31:32.591 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:32.590+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:32.623 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.623 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:131: finishing copy_from racing read to smithi16036501-7 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:131: finishing copy_from to smithi16036501-7 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 7 v 18 (ObjNum 63 snap 3 seq_num 63) dirty exists 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:131: done (2 left) 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:132: done (1 left) 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:133: done (0 left) 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 39 current snap is 8 2024-09-18T10:31:32.633 INFO:tasks.rados.rados.0.smithi160.stdout:134: seq_num 80 ranges {638976=589824,1228800=573440,1802240=196608} 2024-09-18T10:31:32.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:32.639 INFO:tasks.rados.rados.0.smithi160.stdout:134: writing smithi16036501-39 from 638976 to 1228800 tid 1 2024-09-18T10:31:32.643 INFO:tasks.rados.rados.0.smithi160.stdout:134: writing smithi16036501-39 from 1228800 to 1802240 tid 2 2024-09-18T10:31:32.644 INFO:tasks.rados.rados.0.smithi160.stdout:134: writing smithi16036501-39 from 1802240 to 1998848 tid 3 2024-09-18T10:31:32.644 INFO:tasks.rados.rados.0.smithi160.stdout:135: snap_remove snap 5 2024-09-18T10:31:32.692 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:32.691+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:32.733 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.733 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.741 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:32.794 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:32.792+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:32.879 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.879 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.888 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:32.895 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:32.894+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:32.986 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:32.986 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:32.994 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:32.995 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:32.994+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:33.092 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:33.093 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:33.096 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:33.095+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:33.101 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:33.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:33.197 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:33.195+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:33.198 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:33.198 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:33.207 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:33.298 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:33.297+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:33.304 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:33.304 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:33.310 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:33.313 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:31:33.327 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:33.338 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:31:33.343 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:33.358 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:33.374 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:33.374 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:33.390 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:33.390 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:33.399 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:33.398+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:33.406 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:33.406 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:33.411 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:33.411 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:33.420 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:31:33.422 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:33.437 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:33.438 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:33.456 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:33.456 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:33.472 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:33.472 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:33.487 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:33.488 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:33.499 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:33.498+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:33.503 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:33.503 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:33.518 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:33.518 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:33.518 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:33.519 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:33.526 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:31:33.534 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:33.535 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:33.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:33.549+0000 7f35f50f1640 0 -- 172.21.15.63:0/3755772869 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7f35f0197c00 msgr2=0x7f35f019a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:33.552 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:33.587 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T10:31:33.593 INFO:tasks.rados.rados.0.smithi160.stdout:135: done (1 left) 2024-09-18T10:31:33.593 INFO:tasks.rados.rados.0.smithi160.stdout:136: copy_from oid 23 from oid 8 current snap is 8 2024-09-18T10:31:33.593 INFO:tasks.rados.rados.0.smithi160.stdout:134: finishing write tid 1 to smithi16036501-39 2024-09-18T10:31:33.593 INFO:tasks.rados.rados.0.smithi160.stdout:134: finishing write tid 2 to smithi16036501-39 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:134: finishing write tid 3 to smithi16036501-39 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:134: finishing write tid 4 to smithi16036501-39 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:134: finishing write tid 5 to smithi16036501-39 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 39 v 37 (ObjNum 80 snap 8 seq_num 80) dirty exists 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:134: left oid 39 (ObjNum 80 snap 8 seq_num 80) 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:134: done (1 left) 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:137: read oid 33 snap -1 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:137: expect deleted 2024-09-18T10:31:33.594 INFO:tasks.rados.rados.0.smithi160.stdout:138: delete oid 5 current snap is 8 2024-09-18T10:31:33.600 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:33.598+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:33.604 INFO:tasks.rados.rados.0.smithi160.stdout:137: done (2 left) 2024-09-18T10:31:33.604 INFO:tasks.rados.rados.0.smithi160.stdout:138: done (1 left) 2024-09-18T10:31:33.604 INFO:tasks.rados.rados.0.smithi160.stdout:139: setattr oid 32 current snap is 8 2024-09-18T10:31:33.604 INFO:tasks.rados.rados.0.smithi160.stdout:136: finishing copy_from racing read to smithi16036501-23 2024-09-18T10:31:33.605 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T10:31:33.606 INFO:tasks.rados.rados.0.smithi160.stdout:140: delete oid 12 current snap is 8 2024-09-18T10:31:33.608 INFO:tasks.rados.rados.0.smithi160.stdout:136: finishing copy_from to smithi16036501-23 2024-09-18T10:31:33.608 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 23 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-18T10:31:33.612 INFO:tasks.rados.rados.0.smithi160.stdout:136: done (2 left) 2024-09-18T10:31:33.613 INFO:tasks.rados.rados.0.smithi160.stdout:140: done (1 left) 2024-09-18T10:31:33.613 INFO:tasks.rados.rados.0.smithi160.stdout:141: snap_create 2024-09-18T10:31:33.613 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 32 v 24 (ObjNum 67 snap 4 seq_num 67) dirty exists 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:41 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'23, mlcod=24'19)", 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.635751636999998, 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055352270000000002, 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.634 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996042+0000", 2024-09-18T10:31:33.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996105+0000", 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3058999999999994e-05 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996120+0000", 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4555999999999999e-05 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996126+0000", 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1550000000000004e-06 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996159+0000", 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3147e-05 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996172+0000", 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2802e-05 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001546+0000", 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053743339999999997 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001578+0000", 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1952000000000002e-05 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.638 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:42 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'24, mlcod=24'19)", 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.63529539, 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050999269999999998, 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.639 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996515+0000", 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6300999999999999e-05 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996523+0000", 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.1079999999999993e-06 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996532+0000", 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5059999999999995e-06 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996567+0000", 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5596999999999998e-05 2024-09-18T10:31:33.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996587+0000", 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9828999999999999e-05 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001580+0000", 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049931979999999999 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001599+0000", 2024-09-18T10:31:33.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8725000000000001e-05 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:43 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'25, mlcod=24'19)", 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996916+0000", 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.634878389000001, 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047094709999999998, 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.643 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996916+0000", 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996916+0000", 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996916+0000", 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996922+0000", 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3169999999999998e-06 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996930+0000", 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6129999999999998e-06 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996933+0000", 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2540000000000001e-06 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996963+0000", 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0154e-05 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996976+0000", 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3054000000000001e-05 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001603+0000", 2024-09-18T10:31:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046270959999999998 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001626+0000", 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2614000000000001e-05 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:47 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'29, mlcod=24'20)", 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.999666+0000", 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.632128818999998, 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0044867939999999997, 2024-09-18T10:31:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999666+0000", 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999666+0000", 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999664+0000", 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999733+0000", 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8979000000000005e-05 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999747+0000", 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3814e-05 2024-09-18T10:31:33.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999751+0000", 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6029999999999998e-06 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999786+0000", 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4981000000000003e-05 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.999800+0000", 2024-09-18T10:31:33.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3407000000000001e-05 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.004120+0000", 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0043206329999999999 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.004153+0000", 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2329999999999997e-05 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.651 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:50 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'32, mlcod=24'21)", 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.630782111999999, 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058482279999999996, 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.652 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001012+0000", 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001087+0000", 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5179999999999995e-05 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001097+0000", 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0253e-05 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001105+0000", 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9410000000000007e-06 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001141+0000", 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5515999999999997e-05 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001162+0000", 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0917999999999999e-05 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006825+0000", 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056635110000000004 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006861+0000", 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5673000000000002e-05 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:51 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'33, mlcod=24'21)", 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.630238268999999, 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053261339999999997, 2024-09-18T10:31:33.656 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001563+0000", 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1199999999999996e-06 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001574+0000", 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1612e-05 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001580+0000", 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4779999999999999e-06 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001721+0000", 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000141409 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001735+0000", 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3767999999999999e-05 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006863+0000", 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051274720000000001 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006883+0000", 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0006000000000001e-05 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.660 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:52 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'34, mlcod=24'21)", 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.629861019, 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049710359999999999, 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.661 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001933+0000", 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001939+0000", 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2859999999999996e-06 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001948+0000", 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6559999999999998e-06 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001952+0000", 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6239999999999999e-06 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001986+0000", 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4764000000000001e-05 2024-09-18T10:31:33.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.002005+0000", 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8576e-05 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006885+0000", 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004879904 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006905+0000", 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9792e-05 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:71 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'49, mlcod=25'45)", 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.497988325000001, 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060683170000000002, 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.665 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.666 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133811+0000", 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4179999999999996e-06 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133820+0000", 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9050000000000003e-06 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133824+0000", 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3969999999999998e-06 2024-09-18T10:31:33.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133864+0000", 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0028999999999999e-05 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133883+0000", 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9049e-05 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139840+0000", 2024-09-18T10:31:33.668 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059569510000000003 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139875+0000", 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5117000000000003e-05 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:72 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'50, mlcod=25'45)", 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.497580032999998, 2024-09-18T10:31:33.669 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056771290000000004, 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.670 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134214+0000", 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134252+0000", 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7412e-05 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134261+0000", 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.671 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134271+0000", 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0716999999999999e-05 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134305+0000", 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4031e-05 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134325+0000", 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9318e-05 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.672 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139878+0000", 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055528139999999997 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139892+0000", 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4192999999999999e-05 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.673 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:73 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'51, mlcod=25'45)", 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.497064448, 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051763119999999998, 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:33.674 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.675 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134734+0000", 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1500000000000001e-06 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134741+0000", 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5420000000000002e-06 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134744+0000", 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9699999999999999e-06 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.676 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136224+0000", 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001480234 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136236+0000", 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2357e-05 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139893+0000", 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036565059999999999 2024-09-18T10:31:33.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139907+0000", 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3910999999999999e-05 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:74 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'52, mlcod=25'45)", 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.135080+0000", 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.496714372, 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0048380389999999997, 2024-09-18T10:31:33.678 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135080+0000", 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135080+0000", 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.679 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135080+0000", 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135084+0000", 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5820000000000003e-06 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135092+0000", 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5140000000000004e-06 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.680 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135096+0000", 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5880000000000002e-06 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136445+0000", 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00134931 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136458+0000", 2024-09-18T10:31:33.681 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.33e-05 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139908+0000", 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034493660000000002 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139918+0000", 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0832000000000001e-05 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:75 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'53, mlcod=25'45)", 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.496311767000002, 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070322270000000003, 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.683 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135546+0000", 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3405999999999996e-05 2024-09-18T10:31:33.684 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135554+0000", 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5780000000000001e-06 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135557+0000", 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.912e-06 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136700+0000", 2024-09-18T10:31:33.685 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00114241 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136711+0000", 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1445e-05 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142483+0000", 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057715509999999998 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.686 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142515+0000", 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2313e-05 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:76 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'54, mlcod=25'45)", 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.495714916000001, 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091963210000000004, 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.687 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136079+0000", 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136090+0000", 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0294e-05 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136096+0000", 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5549999999999999e-06 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.689 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136099+0000", 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1650000000000002e-06 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139649+0000", 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0035492869999999999 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139663+0000", 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4232e-05 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.690 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145234+0000", 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055716799999999999 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145276+0000", 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1618e-05 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.691 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:79 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'57, mlcod=25'53)", 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.484690207, 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057630829999999996, 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.692 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147180+0000", 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6073000000000002e-05 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.693 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147189+0000", 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4460000000000001e-06 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147192+0000", 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6349999999999999e-06 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147225+0000", 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3318000000000002e-05 2024-09-18T10:31:33.694 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147240+0000", 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4397e-05 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152821+0000", 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005580616 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152868+0000", 2024-09-18T10:31:33.695 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7043999999999999e-05 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:80 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'58, mlcod=25'53)", 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.484265925999999, 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053579960000000003, 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.696 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147528+0000", 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.697 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147600+0000", 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2118000000000003e-05 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147609+0000", 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8189999999999998e-06 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.698 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147613+0000", 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8410000000000002e-06 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147643+0000", 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0179999999999999e-05 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.700 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147656+0000", 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2843999999999999e-05 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152871+0000", 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052145810000000003 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152887+0000", 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6124e-05 2024-09-18T10:31:33.701 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.352139824, 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055838909999999997, 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.702 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:33.703 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280401+0000", 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074599499999999995 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280415+0000", 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4711e-05 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.704 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280422+0000", 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6209999999999998e-06 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280486+0000", 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3670999999999994e-05 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280494+0000", 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8599999999999993e-06 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.705 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285203+0000", 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047090980000000001 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285239+0000", 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6112999999999998e-05 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.706 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 39/33 ECSubWrite(tid=30, reqid=client.4589.0:208, at_version=39'20, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.281410+0000", 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.3503847960000002, 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0044408069999999997, 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281410+0000", 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.707 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281410+0000", 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281409+0000", 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281732+0000", 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00032229099999999999 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.708 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281743+0000", 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1365999999999999e-05 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281748+0000", 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9969999999999998e-06 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281779+0000", 2024-09-18T10:31:33.709 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1312000000000001e-05 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.281785+0000", 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.9710000000000001e-06 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285809+0000", 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0040239910000000002 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.710 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285851+0000", 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1449999999999998e-05 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.3184284780000004, 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050229960000000001, 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.711 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.712 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313389+0000", 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3708000000000001e-05 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313401+0000", 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1531e-05 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.713 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313408+0000", 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1029999999999996e-06 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313454+0000", 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6489999999999997e-05 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.714 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313463+0000", 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318360+0000", 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0048972959999999998 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318389+0000", 2024-09-18T10:31:33.715 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8866000000000001e-05 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s4 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.3091628889999996, 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056939590000000002, 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.716 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322631+0000", 2024-09-18T10:31:33.717 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322653+0000", 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1883e-05 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322665+0000", 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2434e-05 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322672+0000", 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1799999999999999e-06 2024-09-18T10:31:33.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322722+0000", 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9963999999999998e-05 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322730+0000", 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0859999999999996e-06 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328297+0000", 2024-09-18T10:31:33.719 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005567326 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328326+0000", 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8915e-05 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as5 45/33 ECSubWrite(tid=79, reqid=client.4589.0:295, at_version=45'24, trim_to=0'0, roll_forward_to=44'22))", 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:30.324505+0000", 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.30728935, 2024-09-18T10:31:33.720 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049703819999999998, 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.324505+0000", 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.324505+0000", 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.721 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.324504+0000", 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.325143+0000", 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00063881599999999995 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.325161+0000", 2024-09-18T10:31:33.722 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8139e-05 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.325169+0000", 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4980000000000006e-06 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.325219+0000", 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9437000000000001e-05 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:33.723 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.325234+0000", 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4793999999999999e-05 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.329434+0000", 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042004649999999996 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.329476+0000", 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1538000000000001e-05 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.724 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.725 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.725 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:33.725 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:33.725 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:33.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:33.727 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:33.725+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:33.827 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:33.826+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:33.829 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:33.829 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:33.829 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:33.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:33.929 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:33.927+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:33.941 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:33.941 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:33.941 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:33.941 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:33.941 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:33.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:34.030 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:34.028+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:34.054 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.054 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:195 3.6s0 3:61b75516:::smithi16036501-13:head [create,setxattr Y`URWapPpbRbcVnVY`QSNsZaZVYgbfr]kcmrp_g\\ (35) in=40b,setxattr QSnNfhP`\\rbs^]tkaRf]mXj_]bm_arNTstOQjkpY (1332) in=40b,setxattr YOlbral_g[Tac`rkYhXkaidaYfloWs]f`[kfmoeq (1402) in=40b,setxattr O\\Up[arf_O^_OTehidgQm\\_dWqiOgZeddoq[Yeim (421) in=40b,setxattr OliOVUW (1227) in=7b,setxattr mRZhPnOqZXai[tb[_iYpr_fWU`VpVZePspesWXth (9612) in=40b,setxattr p`]Nq_ParoVlgZ_RfOmdYljgitUhq[nn^STkQnm\\ (489) in=40b,setxattr gac_OaSTa[cilYpd\\TYRomd[_[t]lkbeSfUstbbO (385) in=40b,setxattr [^knka[\\][o`oZ[XWVa\\nRZ_^]h[\\ZPq`fqVZUm` (13472) in=40b,setxattr paYr[ki]Uj^gZYZXoSk]OhhpsdnXbWSQNQUhgNgp (1649) in=40b,setxattr SXYNfcNts[adfhlcih^SbYXacRgpdjjt_UedQoso (1789) in=40b,setxattr SsZS^dPc\\fk]ZQjgZ[i]iageNpNcccY^_QpkmcZR (1121) in=40b,setxattr cbOj`RWijYOTWkn\\Sk\\N_a[otcWhlc_kPXhaQhtm (1402) in=40b,setxattr fddhrQT_f\\R (1227) in=11b,setxattr jffqjeh^Weeqcg^`^Wa]]on^og\\VRjnkZqT\\oRWq (243) in=40b,setxattr i[eniSaVsaY_koZilr\\[qpYgN_PenNUPlN\\hNr]Z (1929) in=40b,setxattr Sbtooedescb]TlUVZR^hh[icrap_aWR^_mTZalnt (1963) in=40b,setxattr iYtRdsiUT^YaZcYqmPkOTbnaa_c^ (1227) in=28b,setxattr ao`Z_^XlrOjfeg]XV`]_[il^OU]]def]hmcaTagQ (349) in=40b,setxattr gg]bVkQeTo]\\ji^ph[UbnhXh_aaWYaTU_mQp`lPf (3576) in=40b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:23.268309+0000", 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.783427487000001, 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049648280000000001, 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 195 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.055 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268309+0000", 2024-09-18T10:31:34.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268309+0000", 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268307+0000", 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268467+0000", 2024-09-18T10:31:34.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016020499999999999 2024-09-18T10:31:34.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268504+0000", 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7224000000000001e-05 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268529+0000", 2024-09-18T10:31:34.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.442e-05 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268631+0000", 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101983 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.268640+0000", 2024-09-18T10:31:34.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4790000000000002e-06 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.270155+0000", 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001515366 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.270285+0000", 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129777 2024-09-18T10:31:34.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.271099+0000", 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000814217 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.272235+0000", 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001135605 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.273212+0000", 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097677399999999991 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:23.273274+0000", 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2131999999999994e-05 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:207 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~671744] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7769456619999993, 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011106883, 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 207 2024-09-18T10:31:34.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274787+0000", 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999962 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275694+0000", 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090683300000000001 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275721+0000", 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6876000000000002e-05 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275732+0000", 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1522000000000001e-05 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275808+0000", 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5581999999999996e-05 2024-09-18T10:31:34.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275818+0000", 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0659000000000001e-05 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278499+0000", 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026808629999999999 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278574+0000", 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4624999999999998e-05 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.279516+0000", 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094181099999999997 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284510+0000", 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049937749999999998 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285779+0000", 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001269648 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285898+0000", 2024-09-18T10:31:34.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118659 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:208 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277091+0000", 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7746454390000004, 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093328860000000003, 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 208 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277091+0000", 2024-09-18T10:31:34.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277091+0000", 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277090+0000", 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277443+0000", 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035313599999999999 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277459+0000", 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6319000000000001e-05 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277465+0000", 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7690000000000002e-06 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277511+0000", 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6167e-05 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277516+0000", 2024-09-18T10:31:34.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8330000000000001e-06 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.280656+0000", 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00314065 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.280728+0000", 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1539999999999996e-05 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.281287+0000", 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00055900600000000002 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286250+0000", 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004963477 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286354+0000", 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103943 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286424+0000", 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9676000000000002e-05 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:209 3.6s0 3:61b75516:::smithi16036501-13:head [setxattr _header (56) in=7b] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277474+0000", 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7742631489999994, 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163821999999999, 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 209 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277474+0000", 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277474+0000", 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277473+0000", 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277478+0000", 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2700000000000004e-06 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277483+0000", 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999996e-06 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277487+0000", 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4109999999999998e-06 2024-09-18T10:31:34.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277536+0000", 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9292999999999997e-05 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277540+0000", 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.036e-06 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283369+0000", 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058282780000000001 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283496+0000", 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012768400000000001 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284110+0000", 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061387400000000004 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287076+0000", 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029661900000000001 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287154+0000", 2024-09-18T10:31:34.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7652999999999997e-05 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287637+0000", 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000483401 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.086 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:210 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7742301079999994, 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011901998, 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 210 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277506+0000", 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277509+0000", 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6199999999999999e-06 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277515+0000", 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.613e-06 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277519+0000", 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.162e-06 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277555+0000", 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6918999999999997e-05 2024-09-18T10:31:34.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277558+0000", 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7980000000000001e-06 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284798+0000", 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072393049999999997 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:34.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284870+0000", 2024-09-18T10:31:34.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2249999999999994e-05 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287687+0000", 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028174189999999998 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287819+0000", 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013145400000000001 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289409+0000", 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015898380000000001 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:223 3.6s0 3:6108c463:::smithi16036501-6:head [rollback 2] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.321949+0000", 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7297879470000002, 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074965020000000004, 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 223 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321949+0000", 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321949+0000", 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321948+0000", 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321953+0000", 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8099999999999997e-06 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321958+0000", 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321961+0000", 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.208e-06 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.323379+0000", 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001417869 2024-09-18T10:31:34.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.323478+0000", 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9118999999999997e-05 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324140+0000", 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00066154099999999997 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.325173+0000", 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010334980000000001 2024-09-18T10:31:34.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329393+0000", 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042201369999999997 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329445+0000", 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1759999999999999e-05 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:224 3.6s0 3:6108c463:::smithi16036501-6:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7297485340000005, 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0076431090000000004, 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 224 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321990+0000", 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3719999999999999e-06 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321995+0000", 2024-09-18T10:31:34.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.096e-06 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321998+0000", 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2109999999999998e-06 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324468+0000", 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024698609999999998 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324534+0000", 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5611999999999995e-05 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324852+0000", 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000317795 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.325585+0000", 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00073348200000000004 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329566+0000", 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039810610000000001 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329631+0000", 2024-09-18T10:31:34.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4937999999999994e-05 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.fs6 40/33 ECSubWrite(tid=64, reqid=osd.13.0:64, at_version=40'22, trim_to=0'0, roll_forward_to=38'20))", 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:25.293212+0000", 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.7585246140000006, 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051717059999999999, 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293212+0000", 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293212+0000", 2024-09-18T10:31:34.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293212+0000", 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293229+0000", 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7076e-05 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293237+0000", 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4020000000000002e-06 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293246+0000", 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8969999999999997e-06 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293284+0000", 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7756000000000002e-05 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.293290+0000", 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5840000000000002e-06 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.298357+0000", 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050669529999999999 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:25.298384+0000", 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7185000000000001e-05 2024-09-18T10:31:34.111 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.7s3 44/33 ECSubWrite(tid=124, reqid=osd.4.0:115, at_version=0'0, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.326279+0000", 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.7254573520000003, 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053414300000000003, 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326279+0000", 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326279+0000", 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326279+0000", 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326290+0000", 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1327e-05 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326302+0000", 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2498e-05 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326309+0000", 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5440000000000004e-06 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326364+0000", 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4799999999999997e-05 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326373+0000", 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7459999999999995e-06 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.331596+0000", 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052221630000000002 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.331621+0000", 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5082000000000001e-05 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:297 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~458752] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.116 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7301816329999999, 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0124782, 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 297 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:31:34.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321554+0000", 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323224+0000", 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00166989 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323245+0000", 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1603999999999998e-05 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323251+0000", 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9070000000000004e-06 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323311+0000", 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9367000000000003e-05 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323391+0000", 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0776e-05 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324288+0000", 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089698299999999996 2024-09-18T10:31:34.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330155+0000", 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058662219999999999 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333879+0000", 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003724195 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334033+0000", 2024-09-18T10:31:34.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015450800000000001 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:298 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7274930340000001, 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012910115999999999, 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.122 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 298 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:31:34.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324242+0000", 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324759+0000", 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051612499999999998 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324774+0000", 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5777000000000002e-05 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324782+0000", 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.593e-06 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325756+0000", 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097372699999999997 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325903+0000", 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014782799999999999 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326741+0000", 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083760900000000001 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330156+0000", 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034153109999999999 2024-09-18T10:31:34.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337078+0000", 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069219210000000002 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337154+0000", 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5430000000000001e-05 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:299 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~294912] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7254902799999998, 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01141987, 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 299 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326245+0000", 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:34.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326658+0000", 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041379600000000002 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6379e-05 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326688+0000", 2024-09-18T10:31:34.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3531e-05 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327587+0000", 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089865099999999999 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327696+0000", 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010859 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328440+0000", 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074455699999999997 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330157+0000", 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017169279999999999 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337590+0000", 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007433271 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337666+0000", 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5909999999999997e-05 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:300 3.6s0 3:6fd2113e:::smithi16036501-26:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.72503699, 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011253185000000001, 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.133 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 300 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326699+0000", 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326705+0000", 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4219999999999997e-06 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326713+0000", 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2179999999999999e-06 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326721+0000", 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8299999999999996e-06 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329116+0000", 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023944589999999998 2024-09-18T10:31:34.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329207+0000", 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1532000000000004e-05 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329752+0000", 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00054480399999999997 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331260+0000", 2024-09-18T10:31:34.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001508258 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337875+0000", 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066149590000000001 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337953+0000", 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7750000000000006e-05 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:301 3.6s0 3:6fd2113e:::smithi16036501-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7250097659999999, 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015768265, 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 301 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.139 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326726+0000", 2024-09-18T10:31:34.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326729+0000", 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3189999999999999e-06 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326739+0000", 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3910000000000004e-06 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326744+0000", 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7119999999999999e-06 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330251+0000", 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003507175 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330345+0000", 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3974999999999994e-05 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338416+0000", 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080714459999999995 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338553+0000", 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013656000000000001 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342495+0000", 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003942409 2024-09-18T10:31:34.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:307 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.724988196, 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010040014, 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.144 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 307 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326751+0000", 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1420000000000002e-06 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326757+0000", 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5029999999999997e-06 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326761+0000", 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8449999999999996e-06 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330395+0000", 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036348040000000002 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330447+0000", 2024-09-18T10:31:34.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2024000000000002e-05 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336788+0000", 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063410860000000001 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:308 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7249714979999999, 2024-09-18T10:31:34.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013544333, 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 308 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326768+0000", 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1820000000000002e-06 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326776+0000", 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5229999999999998e-06 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326781+0000", 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0950000000000003e-06 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330731+0000", 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039508199999999999 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330823+0000", 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1259000000000002e-05 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340309+0000", 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0094867969999999999 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.152 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:309 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7249510780000001, 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015227746, 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.153 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 309 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326785+0000", 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326789+0000", 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7239999999999998e-06 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326797+0000", 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4100000000000008e-06 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326802+0000", 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.549e-06 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332723+0000", 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059212609999999997 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332837+0000", 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114342 2024-09-18T10:31:34.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342013+0000", 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091760220000000007 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpReadReply(3.6s0 45/33 ECSubReadReply(tid=56, attrs_read=0))", 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.335120+0000", 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7166164410000002, 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052207850000000004, 2024-09-18T10:31:34.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335120+0000", 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335120+0000", 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335120+0000", 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336488+0000", 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001368239 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336501+0000", 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2955e-05 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336507+0000", 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.857e-06 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339201+0000", 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002694625 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340341+0000", 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011396119999999999 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.161 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpReadReply(3.6s0 45/33 ECSubReadReply(tid=57, attrs_read=0))", 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.335566+0000", 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.7161704609999999, 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052731549999999999, 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335566+0000", 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335566+0000", 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335566+0000", 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336248+0000", 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00068243299999999998 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336261+0000", 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3190000000000001e-05 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336268+0000", 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5690000000000001e-06 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340769+0000", 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004501428 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340839+0000", 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0110000000000005e-05 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpReadReply(3.6s0 45/33 ECSubReadReply(tid=57, attrs_read=0))", 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.336514+0000", 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.715222604, 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055439169999999998, 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336514+0000", 2024-09-18T10:31:34.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336514+0000", 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336514+0000", 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337215+0000", 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00070135800000000002 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337230+0000", 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4646e-05 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337236+0000", 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7000000000000002e-06 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340950+0000", 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037141829999999998 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342058+0000", 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011074850000000001 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.169 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:34.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:34.171 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:34.170+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:34.272 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:34.271+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:34.273 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:34.273 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:34.273 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:34.273 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:34.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:34.373 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:34.372+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:34.383 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:34.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:34.383 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:34.383 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:34.383 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:34.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:34.473 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:34.473+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:211 3.7s0 3:e6324555:::smithi16036501-16:head [append 0~688128] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.282937+0000", 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.209566022000001, 2024-09-18T10:31:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080405800000000003, 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 211 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.282937+0000", 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.282937+0000", 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.282934+0000", 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283880+0000", 2024-09-18T10:31:34.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094533599999999996 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283906+0000", 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6686000000000002e-05 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283918+0000", 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1212e-05 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283974+0000", 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6626999999999998e-05 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284073+0000", 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8541000000000004e-05 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285368+0000", 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001295329 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289492+0000", 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041237979999999997 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.290935+0000", 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014430420000000001 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.290978+0000", 2024-09-18T10:31:34.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2580999999999998e-05 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:212 3.7s0 3:e6324555:::smithi16036501-16:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.285123+0000", 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.207379954, 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074193779999999999, 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 212 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285123+0000", 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285123+0000", 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285122+0000", 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285515+0000", 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00039341199999999999 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285530+0000", 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4457000000000001e-05 2024-09-18T10:31:34.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285546+0000", 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5959000000000001e-05 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286954+0000", 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00140803 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287063+0000", 2024-09-18T10:31:34.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109577 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287847+0000", 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00078400500000000005 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289494+0000", 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001646357 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.292503+0000", 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030089750000000001 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.292542+0000", 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9814999999999997e-05 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:213 3.7s0 3:e6324555:::smithi16036501-16:head [setxattr _header (56) in=7b] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.506 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.285584+0000", 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.206919424000001, 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0071418669999999997, 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 213 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285584+0000", 2024-09-18T10:31:34.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285584+0000", 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285583+0000", 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285589+0000", 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8510000000000004e-06 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285598+0000", 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0410000000000003e-06 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285603+0000", 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.074e-06 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.288504+0000", 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029016100000000002 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.288578+0000", 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3289999999999998e-05 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.288990+0000", 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041196599999999999 2024-09-18T10:31:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289820+0000", 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083022200000000003 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.292651+0000", 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002831255 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.292725+0000", 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4377999999999998e-05 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:214 3.7s0 3:e6324555:::smithi16036501-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.285608+0000", 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.206894571999999, 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084340760000000004, 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 214 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285608+0000", 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285608+0000", 2024-09-18T10:31:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285608+0000", 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285611+0000", 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.976e-06 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285618+0000", 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0369999999999997e-06 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285622+0000", 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9519999999999996e-06 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289386+0000", 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037643680000000001 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289472+0000", 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6095999999999997e-05 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.293090+0000", 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036178529999999999 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.293158+0000", 2024-09-18T10:31:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8246999999999999e-05 2024-09-18T10:31:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.294042+0000", 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088400299999999996 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:280 3.bs0 3:d87ed2c4:::smithi16036501-44:head [read 0~737280,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.318072+0000", 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1744314229999997, 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065845529999999999, 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 280 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318072+0000", 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318072+0000", 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318071+0000", 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318075+0000", 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5889999999999999e-06 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318081+0000", 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3319999999999997e-06 2024-09-18T10:31:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318087+0000", 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0870000000000003e-06 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319381+0000", 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012942030000000001 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319456+0000", 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4363999999999995e-05 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.324656+0000", 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052005280000000003 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:281 3.bs0 3:d87ed2c4:::smithi16036501-44:head [read 0~737280,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.318092+0000", 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1744108530000004, 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069507060000000001, 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 281 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318092+0000", 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318092+0000", 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318092+0000", 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318094+0000", 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8059999999999999e-06 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318101+0000", 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1040000000000003e-06 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318108+0000", 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8010000000000004e-06 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321782+0000", 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003673782 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321927+0000", 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000144843 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325043+0000", 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031158330000000001 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:284 3.7s0 3:e87f06b8:::smithi16036501-45:8 [read 0~753664,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.318154+0000", 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1743489260000004, 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066734510000000004, 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 284 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318154+0000", 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318154+0000", 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318154+0000", 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318156+0000", 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5610000000000001e-06 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318162+0000", 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.451e-06 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318165+0000", 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7450000000000001e-06 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.322313+0000", 2024-09-18T10:31:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041478770000000003 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.322419+0000", 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106059 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.324828+0000", 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024081760000000002 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:302 3.1s0 3:8a576e44:::smithi16036501-20:head [copy-from ver 5] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1659447329999999, 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020457712999999999, 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 302 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326556+0000", 2024-09-18T10:31:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326570+0000", 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3662999999999999e-05 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326585+0000", 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5468000000000002e-05 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326593+0000", 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326667+0000", 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4306000000000003e-05 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1179999999999992e-06 2024-09-18T10:31:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328239+0000", 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015644680000000001 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328381+0000", 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014198999999999999 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340281+0000", 2024-09-18T10:31:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011899197 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343588+0000", 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003307197 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346944+0000", 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033560090000000001 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347016+0000", 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:303 3.1s0 3:8a576e44:::smithi16036501-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1658954750000001, 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016629574000000001, 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 303 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326607+0000", 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326611+0000", 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0389999999999998e-06 2024-09-18T10:31:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326620+0000", 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6039999999999999e-06 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326630+0000", 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326734+0000", 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104131 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1168999999999999e-05 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328659+0000", 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018941400000000001 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5146999999999999e-05 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343012+0000", 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014297432000000001 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343114+0000", 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010218 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343237+0000", 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123347 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:304 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326637+0000", 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1658661639999996, 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078911369999999995, 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 304 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326637+0000", 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326637+0000", 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326636+0000", 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326641+0000", 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6460000000000001e-06 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326650+0000", 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6180000000000001e-06 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326666+0000", 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5426000000000001e-05 2024-09-18T10:31:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326796+0000", 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000130615 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326804+0000", 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3490000000000003e-06 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019097249999999999 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328901+0000", 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000187438 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334528+0000", 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056269650000000003 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:305 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326681+0000", 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1658217659999996, 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092603330000000008, 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 305 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326681+0000", 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326681+0000", 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326681+0000", 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326692+0000", 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1137e-05 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326701+0000", 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0299999999999999e-06 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326706+0000", 2024-09-18T10:31:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4129999999999997e-06 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326862+0000", 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015603599999999999 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326869+0000", 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8240000000000002e-06 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329393+0000", 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002524091 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329489+0000", 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5935999999999998e-05 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335942+0000", 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064525140000000003 2024-09-18T10:31:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:306 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1657908140000002, 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014939928, 2024-09-18T10:31:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 306 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326715+0000", 2024-09-18T10:31:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7330000000000001e-06 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326724+0000", 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326728+0000", 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0500000000000002e-06 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326892+0000", 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016359100000000001 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326897+0000", 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5670000000000002e-06 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331380+0000", 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044830549999999997 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331488+0000", 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108174 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341652+0000", 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163635000000001 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:310 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1594311829999997, 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011394362999999999, 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 310 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333070+0000", 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334438+0000", 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013686499999999999 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334455+0000", 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6719e-05 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334460+0000", 2024-09-18T10:31:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2140000000000004e-06 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336102+0000", 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016417669999999999 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336227+0000", 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000124669 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338547+0000", 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023200989999999999 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344211+0000", 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056638610000000001 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344388+0000", 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017787200000000001 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344466+0000", 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7768999999999994e-05 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpReadReply(3.7s0 45/33 ECSubReadReply(tid=129, attrs_read=0))", 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.333957+0000", 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1585456010000001, 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077718520000000001, 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333957+0000", 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333957+0000", 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333957+0000", 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335348+0000", 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001391289 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335371+0000", 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2889999999999999e-05 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.335377+0000", 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1569999999999997e-06 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340201+0000", 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048233829999999997 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341729+0000", 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015286119999999999 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:311 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~622592] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1554351550000002, 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266834, 2024-09-18T10:31:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 311 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337066+0000", 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338892+0000", 2024-09-18T10:31:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268259999999999 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338908+0000", 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5418999999999999e-05 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338972+0000", 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4393000000000005e-05 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341761+0000", 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002788633 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341937+0000", 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017614900000000001 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343074+0000", 2024-09-18T10:31:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001136698 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346619+0000", 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035453020000000002 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350277+0000", 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036582979999999999 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350335+0000", 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.736e-05 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:312 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~147456] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1535179529999997, 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014117187999999999, 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 312 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338983+0000", 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339142+0000", 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015861599999999999 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339155+0000", 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2816000000000001e-05 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339164+0000", 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1749999999999994e-06 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344524+0000", 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053596679999999997 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344614+0000", 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0613999999999997e-05 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345181+0000", 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056671599999999999 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346674+0000", 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00149266 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353034+0000", 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063603460000000002 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353102+0000", 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8188000000000005e-05 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:313 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1533312609999999, 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014065207, 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 313 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339171+0000", 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339175+0000", 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5129999999999998e-06 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339186+0000", 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339191+0000", 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1619999999999999e-06 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345694+0000", 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065030009999999996 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345792+0000", 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8045000000000001e-05 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346298+0000", 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050656699999999998 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347147+0000", 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084835599999999998 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353189+0000", 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060422569999999997 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353237+0000", 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7890999999999999e-05 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:314 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.1533063209999996, 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015236665999999999, 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 314 2024-09-18T10:31:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339196+0000", 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339199+0000", 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8890000000000002e-06 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339206+0000", 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:31:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339214+0000", 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1189999999999999e-06 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346686+0000", 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074727989999999996 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:34.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346756+0000", 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9511000000000006e-05 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353571+0000", 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068155439999999998 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353677+0000", 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010571 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.354433+0000", 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075619700000000001 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:317 3.1s0 3:8ee00428:::smithi16036501-24:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.403915+0000", 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.0885883029999999, 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010837074, 2024-09-18T10:31:34.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 317 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403915+0000", 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403915+0000", 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403914+0000", 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403919+0000", 2024-09-18T10:31:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2059999999999998e-06 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403926+0000", 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9430000000000003e-06 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403930+0000", 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.07e-06 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.406258+0000", 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023279049999999999 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.406363+0000", 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010525499999999999 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.406842+0000", 2024-09-18T10:31:34.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047876100000000002 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407375+0000", 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053328900000000005 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.414645+0000", 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072695370000000004 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.414752+0000", 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106838 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:318 3.1s0 3:8ee00428:::smithi16036501-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.0885676039999996, 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012368581, 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:34.603 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 318 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403938+0000", 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9960000000000002e-06 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403945+0000", 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2089999999999999e-06 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403948+0000", 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.712e-06 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407079+0000", 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031311490000000002 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407164+0000", 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5321999999999994e-05 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.415143+0000", 2024-09-18T10:31:34.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079786830000000003 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.415238+0000", 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4784999999999995e-05 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.416304+0000", 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001066223 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:34.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:34.609 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:139: done (1 left) 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:141: done (0 left) 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 10 current snap is 9 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:142: seq_num 83 ranges {0=638976,638976=622592,1261568=147456} 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:142: writing smithi16036501-10 from 0 to 638976 tid 1 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:142: writing smithi16036501-10 from 638976 to 1261568 tid 2 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:142: writing smithi16036501-10 from 1261568 to 1409024 tid 3 2024-09-18T10:31:34.611 INFO:tasks.rados.rados.0.smithi160.stdout:143: snap_remove snap 8 2024-09-18T10:31:34.612 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:34.612 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:31:34.613 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:34.609+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:34.613 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T10:31:34.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T10:31:34.711 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:34.710+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:34.758 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:34.758 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:34.758 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:34.758 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:34.768 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:34.813 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:34.812+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:34.872 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:34.872 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:34.872 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:34.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:34.913 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:34.912+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:35.014 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:35.013+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:35.023 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.023 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.cs1 39/33 ECSubRead(tid=36, to_read={3:3616aa10:::smithi16036501-19:head=0,294912,0}, subchunks={3:3616aa10:::smithi16036501-19:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274795+0000", 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.746629930999999, 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010889140000000001, 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274795+0000", 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274795+0000", 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274794+0000", 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274807+0000", 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3054000000000001e-05 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274842+0000", 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4619000000000002e-05 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274884+0000", 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1690000000000002e-05 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274981+0000", 2024-09-18T10:31:35.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6928000000000004e-05 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275884+0000", 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090295000000000002 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.cs1 39/33 ECSubRead(tid=37, to_read={3:3616aa10:::smithi16036501-19:head=0,294912,0}, subchunks={3:3616aa10:::smithi16036501-19:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.746502623, 2024-09-18T10:31:35.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012142590000000001, 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274922+0000", 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274927+0000", 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1410000000000004e-06 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274935+0000", 2024-09-18T10:31:35.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0940000000000008e-06 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274943+0000", 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8110000000000003e-06 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275927+0000", 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0009837540000000001 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276136+0000", 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020977100000000001 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.cs1 39/33 ECSubRead(tid=38, to_read={3:3616aa10:::smithi16036501-19:head=0,294912,0}, subchunks={3:3616aa10:::smithi16036501-19:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.745258326, 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032113999999999998, 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276166+0000", 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276176+0000", 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8579999999999995e-06 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276194+0000", 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7938999999999999e-05 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276202+0000", 2024-09-18T10:31:35.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5720000000000003e-06 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276257+0000", 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4638000000000001e-05 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.276487+0000", 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023069799999999999 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es4 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.314568+0000", 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.706856395, 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022999409999999998, 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314568+0000", 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314568+0000", 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314568+0000", 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314592+0000", 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4070000000000002e-05 2024-09-18T10:31:35.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314604+0000", 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.219e-05 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314612+0000", 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4590000000000001e-06 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314671+0000", 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9259000000000003e-05 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314681+0000", 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8549999999999997e-06 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.316834+0000", 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021530960000000002 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.316868+0000", 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4267000000000002e-05 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 44/33 ECSubWriteReply(tid=21, last_complete=44'12, committed=1, applied=1))", 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.325714+0000", 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6957107699999998, 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052951300000000001, 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.039 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325714+0000", 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325714+0000", 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325713+0000", 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325719+0000", 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.319e-06 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325732+0000", 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3084e-05 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325739+0000", 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.443e-06 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.325783+0000", 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4478999999999999e-05 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326243+0000", 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046002 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.042 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es4 44/33 ECSubWrite(tid=17, reqid=osd.11.0:16, at_version=0'0, trim_to=0'0, roll_forward_to=44'11))", 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.326269+0000", 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6951556070000002, 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023738840000000002, 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326269+0000", 2024-09-18T10:31:35.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326269+0000", 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326268+0000", 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326280+0000", 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1909000000000001e-05 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326291+0000", 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0869999999999999e-05 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326299+0000", 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2400000000000007e-06 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326352+0000", 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2201999999999999e-05 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326360+0000", 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4400000000000005e-06 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.328616+0000", 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022562160000000001 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.328643+0000", 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6733999999999998e-05 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 49/33 ECSubWrite(tid=61, reqid=osd.5.0:61, at_version=49'16, trim_to=0'0, roll_forward_to=47'14))", 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.591897+0000", 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.429528106, 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018278890000000001, 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.047 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.591897+0000", 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.591897+0000", 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.048 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.591896+0000", 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.591922+0000", 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6043000000000001e-05 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.591934+0000", 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1467e-05 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.591945+0000", 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1239e-05 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592006+0000", 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1017999999999998e-05 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592017+0000", 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1240000000000001e-05 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593692+0000", 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016744570000000001 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593724+0000", 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2549000000000003e-05 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=49'24, trim_to=0'0, roll_forward_to=47'22))", 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.592320+0000", 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4291048499999999, 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001882201, 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592320+0000", 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592320+0000", 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592319+0000", 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592343+0000", 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4079000000000001e-05 2024-09-18T10:31:35.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592355+0000", 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1161e-05 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592361+0000", 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8549999999999996e-06 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592446+0000", 2024-09-18T10:31:35.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4263000000000003e-05 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592456+0000", 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0343000000000001e-05 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594175+0000", 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017187000000000001 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594202+0000", 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7251999999999999e-05 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:366 3.4s0 3:2e7558df:::smithi16036501-5:head [delete] snapc d=[d,b,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.427938084, 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095772340000000004, 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:35.056 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 366 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:31:35.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593485+0000", 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593493+0000", 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9000000000000006e-06 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593511+0000", 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8011000000000001e-05 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593517+0000", 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.781e-06 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593607+0000", 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9117999999999996e-05 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593636+0000", 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9022000000000001e-05 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594774+0000", 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001138376 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594884+0000", 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110449 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595595+0000", 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00071014400000000001 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.598115+0000", 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0025207670000000001 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602981+0000", 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048657020000000004 2024-09-18T10:31:35.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.603064+0000", 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2763999999999996e-05 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 49/33 ECSubWrite(tid=62, reqid=osd.5.0:61, at_version=0'0, trim_to=0'0, roll_forward_to=49'16))", 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.595467+0000", 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4259579439999999, 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092505400000000002, 2024-09-18T10:31:35.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595467+0000", 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595467+0000", 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595466+0000", 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595476+0000", 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0040999999999999e-05 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595487+0000", 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1384e-05 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595494+0000", 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5169999999999996e-06 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595535+0000", 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1496999999999999e-05 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595545+0000", 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3519999999999996e-06 2024-09-18T10:31:35.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596369+0000", 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00082477199999999998 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596392+0000", 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2300999999999999e-05 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.596088+0000", 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4253366940000001, 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035432469999999998, 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596088+0000", 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596088+0000", 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596087+0000", 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596109+0000", 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2007000000000001e-05 2024-09-18T10:31:35.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596119+0000", 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7189999999999996e-06 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596126+0000", 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4049999999999997e-06 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597486+0000", 2024-09-18T10:31:35.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013606720000000001 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597495+0000", 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1130000000000007e-06 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.599603+0000", 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002107491 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.599631+0000", 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8330000000000002e-05 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 49/33 ECSubWriteReply(tid=29, last_complete=49'20, committed=1, applied=1))", 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.602780+0000", 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4186443010000001, 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030413400000000001, 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.071 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602780+0000", 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602780+0000", 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602780+0000", 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602787+0000", 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1389999999999998e-06 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602798+0000", 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1578e-05 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602804+0000", 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8139999999999997e-06 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602895+0000", 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0903999999999996e-05 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.603084+0000", 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018935999999999999 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.074 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 49/33 ECSubWriteReply(tid=30, last_complete=49'22, committed=1, applied=1))", 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.417366589, 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00060681000000000005, 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:31:35.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604057+0000", 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604064+0000", 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7469999999999999e-06 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604075+0000", 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0824e-05 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604081+0000", 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604143+0000", 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2150999999999995e-05 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.604665+0000", 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052208400000000002 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:367 3.4s0 3:22c8281c:::smithi16036501-32:head [create,setxattr nWX_d[W\\dXUWOgbXndrSbcTU`mgjR_]o\\nNcXpin (1403) in=40b,setxattr TSP[ddnm_WR]nh]QhSXpkpmmWeOP^b]baemT^Uqr (630) in=40b,setxattr R[QU^NWYrjfarmhlWmZlUkP\\ipWan`SnqZOX`VWh (806) in=40b,setxattr ]hV\\^[PQZO]n^abhilRfldoUhgtl\\\\oel`mgahd_ (3368) in=40b,setxattr OYc`XQ\\VjZfQ`]OsbemUo_mfVUSc^pNo\\[\\ldrhg (1087) in=40b,setxattr `pZtTmno_eqZOONfatgZ_`nnhemaaQWiteO]dc[V (175) in=40b,setxattr PdQa`feQapkrnjfOUYUeqsOt_hrsg\\noqrcV]pSh (981) in=40b,setxattr bk_QpaSsdlQfT`oa[pTQS_[ad]isfYm^tQNdhSiW (1718) in=40b,setxattr Ys`Y_UZ^PXhpgS`VS]`eVgkcmT^QW[aWscssRRSr (10033) in=40b,setxattr [jd]Q\\qemWTVcc`hiZnsrqrggetajZRa]\\_llS`h (1367) in=40b,setxattr `UajoeZh]tRSf\\[nnVat^TjN^_q`ooQ_br`itgZm (244) in=40b,setxattr Tng[WcWa_dsnRXtZNa^`fle`gQ___mar\\fgRsZVY (665) in=40b,setxattr nogmhepVZfQtnZc^cZSeaaogjklZkrff_Utg`UR^ (15856) in=40b,setxattr gfqSsQY[][rrac[gmaQrTSacNWttTTXhanmRa^fa (1998) in=40b,setxattr V`Y[ddb`_dfep[_]oUoTqQj\\UW[gkesnlgNPYtPa (1438) in=40b,setxattr YgoRVqUOj_mXPXsq^PdjaaolmQsTsTsZpaddktl[ (1400) in=40b,setxattr smn[QVPVkfVs]oTip]jtirOtU\\Pa\\Ym^poZgfZaq (1263) in=40b,setxattr TQSmSs^Z]\\rdosO_a^TOU^[p`jkQb`dXXh]s`Stq (909) in=40b,setxattr faPhpqVXmWh`VeNZo[b^[kYl^[[rYYPRrk_[ON`e (14664) in=40b,setxattr ksO_UmqqQefe[Q\\njt[W_roWeei`]Sn^TV]O^iSW (1963) in=40b] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:31:35.078 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.415289027, 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068636369999999997, 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 367 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606134+0000", 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606259+0000", 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012537799999999999 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606277+0000", 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7677e-05 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606284+0000", 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1629999999999999e-06 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606326+0000", 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1956000000000003e-05 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606462+0000", 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136422 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607463+0000", 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010009730000000001 2024-09-18T10:31:35.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.609207+0000", 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017437399999999999 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612922+0000", 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003715281 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612999+0000", 2024-09-18T10:31:35.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6951000000000002e-05 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.414474539, 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048843690000000004, 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606949+0000", 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606978+0000", 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9088e-05 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606991+0000", 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.254e-05 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606997+0000", 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999999e-06 2024-09-18T10:31:35.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608218+0000", 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001220687 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608228+0000", 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0509999999999999e-05 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611809+0000", 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035805440000000002 2024-09-18T10:31:35.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611834+0000", 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5670999999999999e-05 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 49/33 ECSubWriteReply(tid=31, last_complete=49'22, committed=1, applied=1))", 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607018+0000", 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.414407159, 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001116349, 2024-09-18T10:31:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607018+0000", 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607018+0000", 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607017+0000", 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607021+0000", 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7639999999999999e-06 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607029+0000", 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7360000000000001e-06 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607035+0000", 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2990000000000002e-06 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608119+0000", 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010841729999999999 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608134+0000", 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4831000000000001e-05 2024-09-18T10:31:35.091 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 49/33 ECSubWriteReply(tid=31, last_complete=49'22, committed=1, applied=1))", 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607051+0000", 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4143738889999999, 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011295260000000001, 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607051+0000", 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607051+0000", 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607050+0000", 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607053+0000", 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9950000000000001e-06 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607061+0000", 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8280000000000003e-06 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607066+0000", 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3560000000000003e-06 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608166+0000", 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011005640000000001 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608180+0000", 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4207e-05 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 49/33 ECSubWriteReply(tid=31, last_complete=49'22, committed=1, applied=1))", 2024-09-18T10:31:35.095 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607186+0000", 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4142387510000001, 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001022156, 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607186+0000", 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607186+0000", 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607185+0000", 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607190+0000", 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.729e-06 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607200+0000", 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0118999999999999e-05 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607205+0000", 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1880000000000001e-06 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608199+0000", 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099359600000000002 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608208+0000", 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4639999999999995e-06 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 49/33 ECSubWriteReply(tid=32, last_complete=49'24, committed=1, applied=1))", 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.612701+0000", 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4087238690000001, 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058615299999999996, 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.099 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612701+0000", 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612701+0000", 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612700+0000", 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612705+0000", 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6489999999999999e-06 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612720+0000", 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.518e-05 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612726+0000", 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1689999999999997e-06 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612793+0000", 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6416999999999998e-05 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613287+0000", 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049438699999999999 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.102 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=65, reqid=client.4589.0:368, at_version=0'0, trim_to=0'0, roll_forward_to=49'26))", 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.612839+0000", 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4085860100000001, 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018035639999999999, 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612839+0000", 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612839+0000", 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612838+0000", 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612848+0000", 2024-09-18T10:31:35.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0022e-05 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612865+0000", 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7340999999999999e-05 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612871+0000", 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2580000000000003e-06 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612927+0000", 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6855999999999999e-05 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612937+0000", 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2839999999999995e-06 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.614619+0000", 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016817550000000001 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.614642+0000", 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3689999999999998e-05 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.107 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:35.108 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:35.115 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:35.114+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:35.210 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:35.210 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:35.210 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:35.210 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:35.216 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:35.215+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:35.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:35.317 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:35.316+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:35.362 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:35.362 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:35.363 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:35.363 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:35.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:35.419 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:35.418+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:35.475 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:35.475 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 44/33 ECSubWrite(tid=110, reqid=osd.4.0:110, at_version=44'24, trim_to=0'0, roll_forward_to=42'22))", 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.309186+0000", 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.163434702, 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013959700000000001, 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309186+0000", 2024-09-18T10:31:35.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309186+0000", 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309185+0000", 2024-09-18T10:31:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309210+0000", 2024-09-18T10:31:35.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4876e-05 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309232+0000", 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1701000000000001e-05 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309241+0000", 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2229999999999996e-06 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309299+0000", 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8028000000000001e-05 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.309309+0000", 2024-09-18T10:31:35.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0181e-05 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.310556+0000", 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012469099999999999 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.310582+0000", 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5307999999999999e-05 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es6 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.314598+0000", 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.1580222930000001, 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00155456, 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314598+0000", 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314598+0000", 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314598+0000", 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314630+0000", 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314646+0000", 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5750999999999999e-05 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314653+0000", 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.832e-06 2024-09-18T10:31:35.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314726+0000", 2024-09-18T10:31:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3615999999999994e-05 2024-09-18T10:31:35.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.314736+0000", 2024-09-18T10:31:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8239999999999995e-06 2024-09-18T10:31:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.316125+0000", 2024-09-18T10:31:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001389054 2024-09-18T10:31:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.316153+0000", 2024-09-18T10:31:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7359999999999999e-05 2024-09-18T10:31:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.489 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.317198+0000", 2024-09-18T10:31:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.1554227990000001, 2024-09-18T10:31:35.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015098500000000001, 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317198+0000", 2024-09-18T10:31:35.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317198+0000", 2024-09-18T10:31:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317197+0000", 2024-09-18T10:31:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317208+0000", 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1663e-05 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317222+0000", 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4148000000000001e-05 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317229+0000", 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5579999999999997e-06 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317277+0000", 2024-09-18T10:31:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8208999999999999e-05 2024-09-18T10:31:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.317286+0000", 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8389999999999996e-06 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318684+0000", 2024-09-18T10:31:35.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013983229999999999 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318707+0000", 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3020999999999999e-05 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.498 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 44/33 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=44'28, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.318310+0000", 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.1543099010000004, 2024-09-18T10:31:35.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003074645, 2024-09-18T10:31:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318310+0000", 2024-09-18T10:31:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318310+0000", 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318310+0000", 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318331+0000", 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1211000000000001e-05 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318345+0000", 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4021e-05 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318352+0000", 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5769999999999999e-06 2024-09-18T10:31:35.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318401+0000", 2024-09-18T10:31:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9607999999999997e-05 2024-09-18T10:31:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.318410+0000", 2024-09-18T10:31:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8780000000000004e-06 2024-09-18T10:31:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321370+0000", 2024-09-18T10:31:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029600400000000002 2024-09-18T10:31:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321385+0000", 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4887e-05 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.508 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.bs3 44/33 ECSubRead(tid=118, to_read={3:d87ed2c4:::smithi16036501-44:head=0,184320,0}, subchunks={3:d87ed2c4:::smithi16036501-44:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.319604+0000", 2024-09-18T10:31:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.1530160299999999, 2024-09-18T10:31:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001784445, 2024-09-18T10:31:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319604+0000", 2024-09-18T10:31:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319604+0000", 2024-09-18T10:31:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319604+0000", 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319612+0000", 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3569999999999998e-06 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319626+0000", 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3667e-05 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319633+0000", 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2819999999999999e-06 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319680+0000", 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6984000000000003e-05 2024-09-18T10:31:35.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321389+0000", 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017088419999999999 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpRead(3.bs3 44/33 ECSubRead(tid=121, to_read={3:d87ed2c4:::smithi16036501-44:head=0,184320,0}, subchunks={3:d87ed2c4:::smithi16036501-44:head=[0,1]}, attrs_to_read=))", 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.319800+0000", 2024-09-18T10:31:35.514 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.1528206939999999, 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017482750000000001, 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319800+0000", 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319800+0000", 2024-09-18T10:31:35.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319799+0000", 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319811+0000", 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2362e-05 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319824+0000", 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2177e-05 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.319830+0000", 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4520000000000002e-06 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321423+0000", 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00159315 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.321548+0000", 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012472399999999999 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es6 44/33 ECSubWrite(tid=17, reqid=osd.11.0:16, at_version=0'0, trim_to=0'0, roll_forward_to=44'11))", 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:29.326166+0000", 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.1464542140000002, 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023987140000000001, 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326166+0000", 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326166+0000", 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326165+0000", 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326185+0000", 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0633999999999999e-05 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326207+0000", 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1979000000000001e-05 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326218+0000", 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0288e-05 2024-09-18T10:31:35.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326314+0000", 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6878000000000003e-05 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.326343+0000", 2024-09-18T10:31:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8663e-05 2024-09-18T10:31:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.328539+0000", 2024-09-18T10:31:35.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002195696 2024-09-18T10:31:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:29.328565+0000", 2024-09-18T10:31:35.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5990999999999999e-05 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=60, reqid=osd.5.0:60, at_version=49'24, trim_to=0'0, roll_forward_to=47'22))", 2024-09-18T10:31:35.525 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.592726+0000", 2024-09-18T10:31:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.879894368, 2024-09-18T10:31:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018932770000000001, 2024-09-18T10:31:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592726+0000", 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592726+0000", 2024-09-18T10:31:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592725+0000", 2024-09-18T10:31:35.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592750+0000", 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4479000000000001e-05 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592761+0000", 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1082e-05 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592769+0000", 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6809999999999998e-06 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592825+0000", 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5847999999999998e-05 2024-09-18T10:31:35.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592835+0000", 2024-09-18T10:31:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0087e-05 2024-09-18T10:31:35.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594597+0000", 2024-09-18T10:31:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001762116 2024-09-18T10:31:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594619+0000", 2024-09-18T10:31:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2517000000000001e-05 2024-09-18T10:31:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.534 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 49/33 ECSubWrite(tid=61, reqid=osd.5.0:61, at_version=49'16, trim_to=0'0, roll_forward_to=47'14))", 2024-09-18T10:31:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.592870+0000", 2024-09-18T10:31:35.535 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.8797502829999999, 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001003554, 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592870+0000", 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592870+0000", 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592870+0000", 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592898+0000", 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8381000000000002e-05 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592907+0000", 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.901e-06 2024-09-18T10:31:35.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592912+0000", 2024-09-18T10:31:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2000000000000002e-06 2024-09-18T10:31:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592957+0000", 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5357e-05 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.592966+0000", 2024-09-18T10:31:35.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2539999999999992e-06 2024-09-18T10:31:35.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593842+0000", 2024-09-18T10:31:35.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00087606399999999997 2024-09-18T10:31:35.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593874+0000", 2024-09-18T10:31:35.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1788999999999997e-05 2024-09-18T10:31:35.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 49/33 ECSubWrite(tid=62, reqid=osd.5.0:61, at_version=0'0, trim_to=0'0, roll_forward_to=49'16))", 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.596559+0000", 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.876060837, 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00138383, 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.544 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596559+0000", 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596559+0000", 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596559+0000", 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596573+0000", 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4891e-05 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596591+0000", 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7710000000000002e-05 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596599+0000", 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9000000000000006e-06 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596643+0000", 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4385999999999998e-05 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.596654+0000", 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0859000000000001e-05 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597925+0000", 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012707409999999999 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597943+0000", 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8227999999999999e-05 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.8748167549999999, 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045952509999999998, 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.551 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597803+0000", 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597814+0000", 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1413999999999999e-05 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597824+0000", 2024-09-18T10:31:35.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6989999999999998e-06 2024-09-18T10:31:35.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597830+0000", 2024-09-18T10:31:35.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9839999999999998e-06 2024-09-18T10:31:35.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597886+0000", 2024-09-18T10:31:35.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6334e-05 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597895+0000", 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5599999999999994e-06 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602372+0000", 2024-09-18T10:31:35.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044773520000000004 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602399+0000", 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6472e-05 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 49/33 ECSubWrite(tid=171, reqid=osd.4.0:171, at_version=49'39, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606060+0000", 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.866560526, 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029354369999999999, 2024-09-18T10:31:35.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606060+0000", 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606060+0000", 2024-09-18T10:31:35.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606060+0000", 2024-09-18T10:31:35.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606088+0000", 2024-09-18T10:31:35.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8232e-05 2024-09-18T10:31:35.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606135+0000", 2024-09-18T10:31:35.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7068999999999999e-05 2024-09-18T10:31:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606147+0000", 2024-09-18T10:31:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2666e-05 2024-09-18T10:31:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606208+0000", 2024-09-18T10:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0642e-05 2024-09-18T10:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606222+0000", 2024-09-18T10:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3906999999999999e-05 2024-09-18T10:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608970+0000", 2024-09-18T10:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002748417 2024-09-18T10:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608995+0000", 2024-09-18T10:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4765000000000001e-05 2024-09-18T10:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.865630608, 2024-09-18T10:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047167229999999999, 2024-09-18T10:31:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.570 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.570 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:31:35.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606989+0000", 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607014+0000", 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4873999999999999e-05 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607029+0000", 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5136e-05 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607036+0000", 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7340000000000002e-06 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607236+0000", 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020045800000000001 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607246+0000", 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.009e-05 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611683+0000", 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044365819999999997 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611706+0000", 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3509000000000001e-05 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.574 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.8655586720000001, 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046098479999999997, 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607061+0000", 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607083+0000", 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1835999999999999e-05 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607093+0000", 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9049999999999992e-06 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607100+0000", 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2450000000000001e-06 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607147+0000", 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7092999999999998e-05 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607154+0000", 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5799999999999997e-06 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611645+0000", 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044915099999999998 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611671+0000", 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6421999999999999e-05 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 49/33 ECSubWrite(tid=173, reqid=osd.4.0:172, at_version=0'0, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.612697+0000", 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.8599230009999999, 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018212930000000001, 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612697+0000", 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612697+0000", 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612697+0000", 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612714+0000", 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7742999999999999e-05 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612731+0000", 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6334999999999999e-05 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612738+0000", 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8800000000000002e-06 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612797+0000", 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9416000000000002e-05 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612807+0000", 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0210999999999999e-05 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.614494+0000", 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016864740000000001 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.614519+0000", 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4984e-05 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.583 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=65, reqid=client.4589.0:368, at_version=0'0, trim_to=0'0, roll_forward_to=49'26))", 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.613046+0000", 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.859574625, 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001730306, 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613046+0000", 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613046+0000", 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613045+0000", 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613055+0000", 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0200000000000001e-05 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613067+0000", 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613072+0000", 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.959e-06 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613121+0000", 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8359999999999998e-05 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.613130+0000", 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3209999999999994e-06 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.614750+0000", 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001619721 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.614776+0000", 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6126e-05 2024-09-18T10:31:35.587 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=174, reqid=client.4589.0:370, at_version=50'42, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.600056+0000", 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.87256386699999999, 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026626089999999998, 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600056+0000", 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600056+0000", 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600056+0000", 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600176+0000", 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120023 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600189+0000", 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600195+0000", 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6989999999999997e-06 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600270+0000", 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4225000000000002e-05 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600281+0000", 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1705000000000001e-05 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602678+0000", 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023966180000000001 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602719+0000", 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1071e-05 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.87128634199999999, 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010486074, 2024-09-18T10:31:35.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601333+0000", 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601448+0000", 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115426 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601462+0000", 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3579e-05 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601469+0000", 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0530000000000001e-06 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601650+0000", 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000181273 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601659+0000", 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3739999999999998e-06 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611795+0000", 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010135877999999999 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611820+0000", 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5400000000000001e-05 2024-09-18T10:31:35.596 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.87001559699999997, 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095436749999999997, 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602604+0000", 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:35.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602653+0000", 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8948e-05 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602666+0000", 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2779000000000001e-05 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602674+0000", 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3210000000000005e-06 2024-09-18T10:31:35.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602759+0000", 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5636999999999993e-05 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602770+0000", 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0465000000000001e-05 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612126+0000", 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093557369999999994 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612148+0000", 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2736000000000001e-05 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:35.601 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.86885820700000005, 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084016750000000008, 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:31:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603761+0000", 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603784+0000", 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2696000000000001e-05 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603798+0000", 2024-09-18T10:31:35.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4199000000000001e-05 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603805+0000", 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6200000000000001e-06 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603872+0000", 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7512e-05 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:35.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603883+0000", 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729e-05 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612153+0000", 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082698349999999997 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.078e-05 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.605 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.606 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:35.606 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:35.606 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:35.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:35.608 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:35.606+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:35.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:35.609 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:143: done (1 left) 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:144: read oid 35 snap -1 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:144: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:145: snap_create 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:142: finishing write tid 1 to smithi16036501-10 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:142: finishing write tid 2 to smithi16036501-10 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:142: finishing write tid 3 to smithi16036501-10 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:142: finishing write tid 4 to smithi16036501-10 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:142: finishing write tid 5 to smithi16036501-10 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 10 v 45 (ObjNum 83 snap 9 seq_num 83) dirty exists 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:142: left oid 10 (ObjNum 83 snap 9 seq_num 83) 2024-09-18T10:31:35.610 INFO:tasks.rados.rados.0.smithi160.stdout:144: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-18T10:31:35.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T10:31:35.708 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:35.707+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:35.719 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:35.719 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:35.719 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:35.719 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:35.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:35.735 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:35.735 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:35.752 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:35.753 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:35.769 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:35.785 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:35.786 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:35.801 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:35.801 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:35.810 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:35.809+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:35.817 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:35.818 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:35.828 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:35.828 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:35.833 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:35.834 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:35.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:35.849 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:35.849 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:35.864 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:35.880 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:35.880 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:35.896 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:35.910 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:35.909+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:35.912 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:35.927 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:35.926+0000 7f081520b640 0 -- 172.21.15.63:0/4122770314 >> [v2:172.21.15.71:6824/32744,v1:172.21.15.71:6825/32744] conn(0x7f081018f890 msgr2=0x7f0810191cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-18T10:31:35.934 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:35.934 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:35.943 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:36.011 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:36.009+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:36.041 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.042 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:36.134 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:36.133+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:36.145 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:36.161 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:36.161 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:36.188 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.188 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:36.212 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:36.211+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:36.313 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:36.312+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:36.334 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.334 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:36.376+0000 7f0815a0c640 0 -- 172.21.15.63:0/4122770314 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7f0810195f10 msgr2=0x7f08101982f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:36.379 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:36.432 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:36.431+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:36.440 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.440 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:36.515 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:36.514+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:36.545 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.546 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:36.604 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T10:31:36.606 INFO:tasks.rados.rados.0.smithi160.stdout:142: done (2 left) 2024-09-18T10:31:36.606 INFO:tasks.rados.rados.0.smithi160.stdout:144: done (1 left) 2024-09-18T10:31:36.606 INFO:tasks.rados.rados.0.smithi160.stdout:145: done (0 left) 2024-09-18T10:31:36.606 INFO:tasks.rados.rados.0.smithi160.stdout:146: read oid 9 snap 9 2024-09-18T10:31:36.607 INFO:tasks.rados.rados.0.smithi160.stdout:146: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-18T10:31:36.607 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 15 current snap is 10 2024-09-18T10:31:36.607 INFO:tasks.rados.rados.0.smithi160.stdout:147: seq_num 84 ranges {245760=655360,901120=638976,1540096=131072} 2024-09-18T10:31:36.610 INFO:tasks.rados.rados.0.smithi160.stdout:147: writing smithi16036501-15 from 245760 to 901120 tid 1 2024-09-18T10:31:36.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:31:36.617 INFO:tasks.rados.rados.0.smithi160.stdout:147: writing smithi16036501-15 from 901120 to 1540096 tid 2 2024-09-18T10:31:36.617 INFO:tasks.rados.rados.0.smithi160.stdout:147: writing smithi16036501-15 from 1540096 to 1671168 tid 3 2024-09-18T10:31:36.617 INFO:tasks.rados.rados.0.smithi160.stdout:148: setattr oid 2 current snap is 10 2024-09-18T10:31:36.617 INFO:tasks.rados.rados.0.smithi160.stdout:146: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-18T10:31:36.617 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:36.615+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:36.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T10:31:36.623 INFO:tasks.rados.rados.0.smithi160.stdout:147: finishing write tid 1 to smithi16036501-15 2024-09-18T10:31:36.623 INFO:tasks.rados.rados.0.smithi160.stdout:147: finishing write tid 2 to smithi16036501-15 2024-09-18T10:31:36.623 INFO:tasks.rados.rados.0.smithi160.stdout:147: finishing write tid 3 to smithi16036501-15 2024-09-18T10:31:36.623 INFO:tasks.rados.rados.0.smithi160.stdout:147: finishing write tid 4 to smithi16036501-15 2024-09-18T10:31:36.623 INFO:tasks.rados.rados.0.smithi160.stdout:147: finishing write tid 5 to smithi16036501-15 2024-09-18T10:31:36.624 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 15 v 40 (ObjNum 84 snap 10 seq_num 84) dirty exists 2024-09-18T10:31:36.624 INFO:tasks.rados.rados.0.smithi160.stdout:147: left oid 15 (ObjNum 84 snap 10 seq_num 84) 2024-09-18T10:31:36.624 INFO:tasks.rados.rados.0.smithi160.stdout:146: done (2 left) 2024-09-18T10:31:36.624 INFO:tasks.rados.rados.0.smithi160.stdout:147: done (1 left) 2024-09-18T10:31:36.624 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 4 current snap is 10 2024-09-18T10:31:36.625 INFO:tasks.rados.rados.0.smithi160.stdout:149: seq_num 85 ranges {1228800=671744,1900544=770048} 2024-09-18T10:31:36.632 INFO:tasks.rados.rados.0.smithi160.stdout:149: writing smithi16036501-4 from 1228800 to 1900544 tid 1 2024-09-18T10:31:36.636 INFO:tasks.rados.rados.0.smithi160.stdout:149: writing smithi16036501-4 from 1900544 to 2670592 tid 2 2024-09-18T10:31:36.637 INFO:tasks.rados.rados.0.smithi160.stdout:150: snap_remove snap 6 2024-09-18T10:31:36.657 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.658 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:36.717 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:36.716+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:36.767 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.768 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.776 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:36.818 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:36.817+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:36.873 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.873 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:36.925 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:36.924+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:36.979 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:36.979 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:36.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:37.020 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:37.019+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:37.100 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.100 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:37.153 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:37.152+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:37.209 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.209 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.217 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:37.222 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:37.220+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:37.322 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:37.322+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:37.356 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.356 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.364 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:37.424 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:37.422+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:37.461 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.461 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:37.524 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:37.523+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:37.568 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.568 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:37.587 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:31:37.587 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T10:31:37.588 INFO:tasks.rados.rados.0.smithi160.stdout:150: done (2 left) 2024-09-18T10:31:37.588 INFO:tasks.rados.rados.0.smithi160.stdout:151: copy_from oid 12 from oid 34 current snap is 10 2024-09-18T10:31:37.588 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 2 v 4 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-18T10:31:37.588 INFO:tasks.rados.rados.0.smithi160.stdout:149: finishing write tid 1 to smithi16036501-4 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:149: finishing write tid 2 to smithi16036501-4 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:149: finishing write tid 3 to smithi16036501-4 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:149: finishing write tid 4 to smithi16036501-4 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 4 v 49 (ObjNum 85 snap 10 seq_num 85) dirty exists 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:149: left oid 4 (ObjNum 85 snap 10 seq_num 85) 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:148: done (2 left) 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:149: done (1 left) 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:152: read oid 8 snap -1 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:152: expect (ObjNum 7 snap 0 seq_num 7) 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:153: rollback oid 45 current snap is 10 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 45 to 7 2024-09-18T10:31:37.589 INFO:tasks.rados.rados.0.smithi160.stdout:154: delete oid 42 current snap is 10 2024-09-18T10:31:37.596 INFO:tasks.rados.rados.0.smithi160.stdout:151: finishing copy_from to smithi16036501-12 2024-09-18T10:31:37.596 INFO:tasks.rados.rados.0.smithi160.stdout:151: got expected ENOENT (src dne) 2024-09-18T10:31:37.596 INFO:tasks.rados.rados.0.smithi160.stdout:151: finishing copy_from racing read to smithi16036501-12 2024-09-18T10:31:37.601 INFO:tasks.rados.rados.0.smithi160.stdout:152: expect (ObjNum 7 snap 0 seq_num 7) 2024-09-18T10:31:37.603 INFO:tasks.rados.rados.0.smithi160.stdout:151: done (3 left) 2024-09-18T10:31:37.603 INFO:tasks.rados.rados.0.smithi160.stdout:152: done (2 left) 2024-09-18T10:31:37.603 INFO:tasks.rados.rados.0.smithi160.stdout:154: done (1 left) 2024-09-18T10:31:37.603 INFO:tasks.rados.rados.0.smithi160.stdout:155: setattr oid 35 current snap is 10 2024-09-18T10:31:37.604 INFO:tasks.rados.rados.0.smithi160.stdout:153: finishing rollback tid 0 to smithi16036501-45 2024-09-18T10:31:37.604 INFO:tasks.rados.rados.0.smithi160.stdout:153: finishing rollback tid 1 to smithi16036501-45 2024-09-18T10:31:37.605 INFO:tasks.rados.rados.0.smithi160.stdout:153: finishing rollback tid 2 to smithi16036501-45 2024-09-18T10:31:37.605 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 45 v 45 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-09-18T10:31:37.605 INFO:tasks.rados.rados.0.smithi160.stdout:153: done (1 left) 2024-09-18T10:31:37.605 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 28 current snap is 10 2024-09-18T10:31:37.605 INFO:tasks.rados.rados.0.smithi160.stdout:156: seq_num 87 ranges {458752=704512,1163264=688128,1851392=81920} 2024-09-18T10:31:37.612 INFO:tasks.rados.rados.0.smithi160.stdout:156: writing smithi16036501-28 from 458752 to 1163264 tid 1 2024-09-18T10:31:37.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T10:31:37.616 INFO:tasks.rados.rados.0.smithi160.stdout:156: writing smithi16036501-28 from 1163264 to 1851392 tid 2 2024-09-18T10:31:37.617 INFO:tasks.rados.rados.0.smithi160.stdout:156: writing smithi16036501-28 from 1851392 to 1933312 tid 3 2024-09-18T10:31:37.618 INFO:tasks.rados.rados.0.smithi160.stdout:157: rmattr oid 34 current snap is 10 2024-09-18T10:31:37.618 INFO:tasks.rados.rados.0.smithi160.stdout:157: done (2 left) 2024-09-18T10:31:37.618 INFO:tasks.rados.rados.0.smithi160.stdout:158: snap_create 2024-09-18T10:31:37.619 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 35 v 30 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-18T10:31:37.621 INFO:tasks.rados.rados.0.smithi160.stdout:156: finishing write tid 1 to smithi16036501-28 2024-09-18T10:31:37.623 INFO:tasks.rados.rados.0.smithi160.stdout:156: finishing write tid 2 to smithi16036501-28 2024-09-18T10:31:37.623 INFO:tasks.rados.rados.0.smithi160.stdout:156: finishing write tid 3 to smithi16036501-28 2024-09-18T10:31:37.624 INFO:tasks.rados.rados.0.smithi160.stdout:156: finishing write tid 4 to smithi16036501-28 2024-09-18T10:31:37.625 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:37.624+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:37.626 INFO:tasks.rados.rados.0.smithi160.stdout:156: finishing write tid 5 to smithi16036501-28 2024-09-18T10:31:37.626 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 28 v 36 (ObjNum 87 snap 10 seq_num 87) dirty exists 2024-09-18T10:31:37.626 INFO:tasks.rados.rados.0.smithi160.stdout:156: left oid 28 (ObjNum 87 snap 10 seq_num 87) 2024-09-18T10:31:37.714 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.714 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:37.725 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:37.724+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:37.822 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.822 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.825 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:37.824+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:37.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:37.926 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:37.925+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:37.928 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:37.928 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:37.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:38.027 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:38.026+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:38.074 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:38.075 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:38.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:38.128 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:38.126+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:38.221 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:38.221 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:38.229 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:38.228+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:38.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:38.327 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:38.327 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:38.329 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:38.329+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:38.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:38.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:38.430 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:38.429+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:38.432 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:38.432 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:38.441 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:38.514 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:38.514 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:38.531 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:38.532 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:38.530+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:38.547 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:38.548 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:38.551 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:38.552 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:38.562 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:38.563 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:38.563 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:38.578 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:38.578 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:38.594 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:38.594 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:38.609 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:38.609 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T10:31:38.627 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:38.628 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:155: done (2 left) 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:156: done (1 left) 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:158: done (0 left) 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:159: read oid 13 snap -1 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:159: expect (ObjNum 62 snap 3 seq_num 62) 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:160: rollback oid 28 current snap is 11 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 28 to 9 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 32 current snap is 11 2024-09-18T10:31:38.630 INFO:tasks.rados.rados.0.smithi160.stdout:161: seq_num 88 ranges {1654784=720896,2375680=442368,2818048=327680} 2024-09-18T10:31:38.633 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:38.631+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:38.642 INFO:tasks.rados.rados.0.smithi160.stdout:161: writing smithi16036501-32 from 1654784 to 2375680 tid 1 2024-09-18T10:31:38.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-18T10:31:38.644 INFO:tasks.rados.rados.0.smithi160.stdout:161: writing smithi16036501-32 from 2375680 to 2818048 tid 2 2024-09-18T10:31:38.646 INFO:tasks.rados.rados.0.smithi160.stdout:161: writing smithi16036501-32 from 2818048 to 3145728 tid 3 2024-09-18T10:31:38.646 INFO:tasks.rados.rados.0.smithi160.stdout:162: snap_remove snap 10 2024-09-18T10:31:38.653 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:38.653 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:38.670 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:38.670 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:38.686 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:38.687 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:38.702 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:38.707 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:38.707 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:38.707 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:38.707 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:38.707 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:38.715 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:38.717 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:38.717 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:38.734 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:38.734 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:38.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:38.733+0000 7f46b6ffd640 0 -- 172.21.15.63:0/3808940588 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7f46b8195550 msgr2=0x7f46b8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-18T10:31:38.756 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:38.755+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:38.835 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:38.833+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 38/33 ECSubWrite(tid=54, reqid=client.4589.0:199, at_version=38'18, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.277690+0000", 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.575799579, 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004809888, 2024-09-18T10:31:38.856 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.277690+0000", 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.277690+0000", 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.857 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.277690+0000", 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278450+0000", 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00075929600000000002 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278466+0000", 2024-09-18T10:31:38.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6399e-05 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278474+0000", 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5250000000000005e-06 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278549+0000", 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4711999999999999e-05 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278564+0000", 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4654000000000001e-05 2024-09-18T10:31:38.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.282470+0000", 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039058579999999999 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.282500+0000", 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0568999999999998e-05 2024-09-18T10:31:38.860 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 38/33 ECSubWrite(tid=55, reqid=client.4589.0:200, at_version=38'19, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.279407+0000", 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.574083160000001, 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059160879999999999, 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.861 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279407+0000", 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279407+0000", 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279406+0000", 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279911+0000", 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050487299999999998 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279928+0000", 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.715e-05 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.863 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279935+0000", 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1029999999999996e-06 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279984+0000", 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8946999999999997e-05 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279992+0000", 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2379999999999997e-06 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285295+0000", 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053024350000000003 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285323+0000", 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8153e-05 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 38/33 ECSubWrite(tid=56, reqid=client.4589.0:201, at_version=38'20, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:38.865 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.280349+0000", 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.573141134, 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053380010000000002, 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280349+0000", 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.866 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280349+0000", 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280348+0000", 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280367+0000", 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9148e-05 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.867 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280379+0000", 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1673e-05 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280386+0000", 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4250000000000001e-06 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.282562+0000", 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002175415 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.868 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.282569+0000", 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0480000000000001e-06 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285662+0000", 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003092923 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285687+0000", 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5006000000000001e-05 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.869 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.es5 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5393254659999993, 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010619747000000001, 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314194+0000", 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9682000000000001e-05 2024-09-18T10:31:38.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314208+0000", 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4456e-05 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314216+0000", 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4039999999999998e-06 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.872 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314276+0000", 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0130000000000002e-05 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314307+0000", 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0667999999999998e-05 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324753+0000", 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010446057999999999 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324784+0000", 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1608e-05 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.2s1 44/33 ECSubWrite(tid=11, reqid=osd.14.0:11, at_version=44'10, trim_to=0'0, roll_forward_to=42'8))", 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5386105039999993, 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010009494000000001, 2024-09-18T10:31:38.874 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314896+0000", 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7241e-05 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314908+0000", 2024-09-18T10:31:38.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1807000000000001e-05 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314914+0000", 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6470000000000003e-06 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314993+0000", 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9171999999999993e-05 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.877 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315014+0000", 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1325999999999999e-05 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324876+0000", 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.009861692 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324889+0000", 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2867000000000001e-05 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.878 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=73, reqid=osd.13.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5378554199999996, 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0092378719999999994, 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:38.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315646+0000", 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2227e-05 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315665+0000", 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9485999999999999e-05 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315676+0000", 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1144e-05 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.881 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315894+0000", 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000217343 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.316163+0000", 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00026891000000000003 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324826+0000", 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086628130000000001 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324872+0000", 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6819e-05 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=74, reqid=client.4589.0:278, at_version=44'22, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5342918230000002, 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091122809999999999, 2024-09-18T10:31:38.883 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319197+0000", 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319499+0000", 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00030185299999999998 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319516+0000", 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7447000000000001e-05 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319524+0000", 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8560000000000007e-06 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319581+0000", 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6787999999999999e-05 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319590+0000", 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2150000000000007e-06 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328264+0000", 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086732709999999998 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328310+0000", 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6757e-05 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s3 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:31:38.887 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5325618419999998, 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013131472, 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320927+0000", 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320950+0000", 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2860000000000001e-05 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320963+0000", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3281999999999999e-05 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320970+0000", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.815e-06 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321072+0000", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000101679 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321082+0000", 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0112000000000001e-05 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334037+0000", 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012954979 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334060+0000", 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2616000000000002e-05 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:285 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~442368] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5304697790000006, 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013315863000000001, 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 285 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.892 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323018+0000", 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323786+0000", 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076849899999999996 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323806+0000", 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9749999999999999e-05 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323816+0000", 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.91e-06 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326375+0000", 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025593740000000001 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326486+0000", 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000110361 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328927+0000", 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024414390000000001 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334196+0000", 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052685989999999997 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336273+0000", 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020772350000000002 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336336+0000", 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2928999999999993e-05 2024-09-18T10:31:38.896 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:286 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~720896] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5247821699999999, 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080273050000000002, 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.897 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 286 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.898 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328706+0000", 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329422+0000", 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00071608700000000002 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329439+0000", 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6762e-05 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329444+0000", 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2220000000000001e-06 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330184+0000", 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074012100000000005 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330295+0000", 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000111335 2024-09-18T10:31:38.900 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331780+0000", 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001484899 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334386+0000", 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0026057580000000001 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336669+0000", 2024-09-18T10:31:38.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002283532 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336735+0000", 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5593999999999996e-05 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:287 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~49152] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329450+0000", 2024-09-18T10:31:38.902 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5240398339999999, 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0074801700000000004, 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 287 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329450+0000", 2024-09-18T10:31:38.903 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329450+0000", 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329449+0000", 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329470+0000", 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0795e-05 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329476+0000", 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2820000000000002e-06 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329480+0000", 2024-09-18T10:31:38.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.269e-06 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.332958+0000", 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034782060000000002 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.333074+0000", 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000115678 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.906 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.333586+0000", 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000512862 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336352+0000", 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002766003 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336893+0000", 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00054050699999999997 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.907 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336930+0000", 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7327999999999999e-05 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:288 3.0s0 3:02ffc1f8:::smithi16036501-17:head [setxattr _header (56) in=7b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5240068299999994, 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0084205180000000001, 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.908 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 288 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.909 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329485+0000", 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.813e-06 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.910 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329489+0000", 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3639999999999999e-06 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329491+0000", 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1789999999999998e-06 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334535+0000", 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050437019999999997 2024-09-18T10:31:38.911 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335074+0000", 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00053956900000000005 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335709+0000", 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00063488599999999998 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.912 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337448+0000", 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001738945 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337849+0000", 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040134200000000001 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337904+0000", 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4129000000000003e-05 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.913 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:289 3.0s0 3:02ffc1f8:::smithi16036501-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.5239963359999997, 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0097207330000000005, 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 289 2024-09-18T10:31:38.914 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.915 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329493+0000", 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329495+0000", 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.376e-06 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329498+0000", 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6380000000000002e-06 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.916 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329501+0000", 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2670000000000001e-06 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337024+0000", 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075235809999999997 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337080+0000", 2024-09-18T10:31:38.917 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5986999999999998e-05 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338204+0000", 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001123476 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338288+0000", 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4359999999999999e-05 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.339214+0000", 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000926333 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs3 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.595342+0000", 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.2581474840000002, 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049948700000000002, 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.919 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595342+0000", 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595342+0000", 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.920 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595342+0000", 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595352+0000", 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0056e-05 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595360+0000", 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9570000000000002e-06 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.921 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595368+0000", 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5569999999999996e-06 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595410+0000", 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1480999999999998e-05 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595419+0000", 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:31:38.922 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.600298+0000", 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0048793990000000004 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.600337+0000", 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8936000000000001e-05 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.923 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597200+0000", 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.2562903519999997, 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055646059999999997, 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597200+0000", 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.924 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597200+0000", 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597199+0000", 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597218+0000", 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9412999999999999e-05 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.925 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597229+0000", 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1158000000000001e-05 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597235+0000", 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0329999999999997e-06 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597335+0000", 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9699999999999998e-05 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597344+0000", 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8380000000000008e-06 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602728+0000", 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053844490000000004 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602764+0000", 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5884999999999999e-05 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.927 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s5 49/33 ECSubWrite(tid=169, reqid=osd.4.0:168, at_version=0'0, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604312+0000", 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.2491775570000003, 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054752200000000003, 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.928 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604312+0000", 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604312+0000", 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604312+0000", 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.929 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604321+0000", 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6900000000000004e-06 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604335+0000", 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3821e-05 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604341+0000", 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2910000000000004e-06 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.930 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604382+0000", 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0750000000000001e-05 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604392+0000", 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4360000000000008e-06 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.931 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609747+0000", 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053556159999999997 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609788+0000", 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0296000000000002e-05 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.932 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs3 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.606806+0000", 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.2466842610000004, 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055384320000000003, 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606806+0000", 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.933 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606806+0000", 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606805+0000", 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606833+0000", 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8019000000000001e-05 2024-09-18T10:31:38.934 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606849+0000", 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5908000000000001e-05 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606857+0000", 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6799999999999993e-06 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606903+0000", 2024-09-18T10:31:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5972e-05 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606910+0000", 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2849999999999997e-06 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612321+0000", 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054109190000000001 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.936 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612344+0000", 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3294000000000001e-05 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:413 3.0s0 3:0a6b7166:::smithi16036501-28:head [append 0~0] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628873+0000", 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 0.224617292, 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0065644930000000002, 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.937 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 413 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628873+0000", 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628873+0000", 2024-09-18T10:31:38.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628870+0000", 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628882+0000", 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2048999999999999e-05 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.939 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628902+0000", 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0018e-05 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628911+0000", 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3939999999999996e-06 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628968+0000", 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7089000000000002e-05 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.940 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op must wait for map", 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628974+0000", 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.404e-06 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.630895+0000", 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001920726 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.630963+0000", 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8238000000000006e-05 2024-09-18T10:31:38.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.631464+0000", 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000500874 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.634449+0000", 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002984792 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.942 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.635345+0000", 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00089566099999999996 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.635437+0000", 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2558000000000004e-05 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:414 3.0s0 3:0a6b7166:::smithi16036501-28:head [rollback 11] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628923+0000", 2024-09-18T10:31:38.943 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 0.22456713, 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.007169529, 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 414 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628923+0000", 2024-09-18T10:31:38.944 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628923+0000", 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628922+0000", 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.945 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628926+0000", 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6219999999999998e-06 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628938+0000", 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1902999999999999e-05 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628942+0000", 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.386e-06 2024-09-18T10:31:38.946 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629017+0000", 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5044999999999997e-05 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629021+0000", 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0430000000000001e-06 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632063+0000", 2024-09-18T10:31:38.947 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0030421480000000002 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632146+0000", 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2208999999999998e-05 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632796+0000", 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00065000400000000003 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.948 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.634576+0000", 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001780137 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636028+0000", 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00145191 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636092+0000", 2024-09-18T10:31:38.949 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4675e-05 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:415 3.0s0 3:0a6b7166:::smithi16036501-28:head [append 0~0] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 0.22453047500000001, 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079305439999999994, 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:38.950 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 415 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.951 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628962+0000", 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4690000000000002e-06 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628969+0000", 2024-09-18T10:31:38.952 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9720000000000003e-06 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628973+0000", 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9740000000000004e-06 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629040+0000", 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6503999999999999e-05 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.953 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629043+0000", 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1329999999999999e-06 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633315+0000", 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042715519999999996 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633399+0000", 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4252999999999994e-05 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.954 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633789+0000", 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00039028199999999999 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636113+0000", 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002324062 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636794+0000", 2024-09-18T10:31:38.955 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00068055999999999998 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636890+0000", 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6304999999999994e-05 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:38.956 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:38.957 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:38.958 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:38.958 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:38.959 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:38.957+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:38.966 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:38.966 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:39.057 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.057 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:39.057 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:39.057 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.058 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:39.057+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:39.065 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:39.160 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:39.159+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:39.162 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.163 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:39.163 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:39.163 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:39.163 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.171 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:39.261 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:39.260+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.2s6 39/33 ECSubWrite(tid=5, reqid=client.4589.0:215, at_version=39'4, trim_to=0'0, roll_forward_to=36'2))", 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.287231+0000", 2024-09-18T10:31:39.270 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.980938126, 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024420449999999999, 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287231+0000", 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287231+0000", 2024-09-18T10:31:39.271 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287231+0000", 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287267+0000", 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6798000000000002e-05 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.272 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287283+0000", 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5182e-05 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287297+0000", 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3913999999999999e-05 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287372+0000", 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5383999999999995e-05 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.273 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.287380+0000", 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6480000000000003e-06 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289632+0000", 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0022521260000000001 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.274 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289673+0000", 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1304000000000003e-05 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 44/33 ECSubWrite(tid=29, reqid=osd.3.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.321308+0000", 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.9468607710000008, 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003276555, 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.275 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321308+0000", 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.276 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321308+0000", 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321307+0000", 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.278 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.278 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.278 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321320+0000", 2024-09-18T10:31:39.278 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2850999999999999e-05 2024-09-18T10:31:39.278 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.278 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321334+0000", 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3997e-05 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321341+0000", 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.199e-06 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321375+0000", 2024-09-18T10:31:39.279 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3713000000000001e-05 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321384+0000", 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3179999999999996e-06 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324551+0000", 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0031663289999999998 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.280 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324585+0000", 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4155000000000001e-05 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.2s6 44/33 ECSubWrite(tid=12, reqid=osd.14.0:11, at_version=0'0, trim_to=0'0, roll_forward_to=44'10))", 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.325956+0000", 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.9422126409999994, 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0021868790000000001, 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.281 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.325956+0000", 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.325956+0000", 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.325955+0000", 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.282 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.325974+0000", 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8182999999999999e-05 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.325986+0000", 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2157999999999999e-05 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.325995+0000", 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0010000000000007e-06 2024-09-18T10:31:39.283 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326056+0000", 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0829999999999999e-05 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326079+0000", 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3163000000000002e-05 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.284 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328119+0000", 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002040657 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328143+0000", 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3947999999999998e-05 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.285 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 44/33 ECSubWrite(tid=31, reqid=client.4589.0:286, at_version=44'21, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.331854+0000", 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.9363155909999996, 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00242085, 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331854+0000", 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.286 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331854+0000", 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331852+0000", 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331962+0000", 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000109725 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.287 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.332011+0000", 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8971000000000003e-05 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.332035+0000", 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3689999999999998e-05 2024-09-18T10:31:39.288 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.332106+0000", 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0796000000000005e-05 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.332117+0000", 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1935e-05 2024-09-18T10:31:39.289 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334250+0000", 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0021326740000000002 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.290 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.291 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334274+0000", 2024-09-18T10:31:39.291 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4247e-05 2024-09-18T10:31:39.291 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.291 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.291 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.291 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.292 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.292 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 44/33 ECSubWrite(tid=34, reqid=client.4589.0:288, at_version=0'0, trim_to=0'0, roll_forward_to=44'23))", 2024-09-18T10:31:39.292 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.338027+0000", 2024-09-18T10:31:39.292 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.9301425220000006, 2024-09-18T10:31:39.292 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024190489999999999, 2024-09-18T10:31:39.292 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338027+0000", 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.293 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.294 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.294 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.294 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338027+0000", 2024-09-18T10:31:39.294 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.294 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.294 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.295 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.295 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338026+0000", 2024-09-18T10:31:39.295 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.295 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.295 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.295 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.296 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338036+0000", 2024-09-18T10:31:39.296 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0569e-05 2024-09-18T10:31:39.296 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.296 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.296 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.296 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338049+0000", 2024-09-18T10:31:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.241e-05 2024-09-18T10:31:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338055+0000", 2024-09-18T10:31:39.297 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5470000000000002e-06 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338122+0000", 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6260000000000006e-05 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.298 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.299 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.299 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338132+0000", 2024-09-18T10:31:39.299 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0947999999999999e-05 2024-09-18T10:31:39.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.299 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.299 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.300 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.340423+0000", 2024-09-18T10:31:39.300 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002290041 2024-09-18T10:31:39.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.300 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.300 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.300 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.340446+0000", 2024-09-18T10:31:39.301 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3119999999999999e-05 2024-09-18T10:31:39.301 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.301 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.301 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.301 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.302 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:31:39.302 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:30.340614+0000", 2024-09-18T10:31:39.302 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.9275554499999998, 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032890279999999998, 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.303 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.340614+0000", 2024-09-18T10:31:39.304 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.304 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.304 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.304 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.305 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.340614+0000", 2024-09-18T10:31:39.305 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.305 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.305 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.305 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.305 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.340613+0000", 2024-09-18T10:31:39.306 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:39.306 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.306 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.306 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.306 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342103+0000", 2024-09-18T10:31:39.306 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0014893619999999999 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342117+0000", 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4153e-05 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.307 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.308 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.308 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342125+0000", 2024-09-18T10:31:39.308 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4530000000000002e-06 2024-09-18T10:31:39.308 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.308 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.308 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.309 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342202+0000", 2024-09-18T10:31:39.309 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6966999999999997e-05 2024-09-18T10:31:39.309 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.309 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.309 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.309 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342214+0000", 2024-09-18T10:31:39.310 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1573000000000001e-05 2024-09-18T10:31:39.310 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.310 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.310 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.310 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.343876+0000", 2024-09-18T10:31:39.310 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0016618 2024-09-18T10:31:39.311 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.311 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.311 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.311 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.343903+0000", 2024-09-18T10:31:39.311 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6923999999999998e-05 2024-09-18T10:31:39.311 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.312 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.312 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.312 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.312 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.312 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 45/33 ECSubWrite(tid=139, reqid=client.4589.0:315, at_version=0'0, trim_to=0'0, roll_forward_to=45'25))", 2024-09-18T10:31:39.312 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:30.401920+0000", 2024-09-18T10:31:39.313 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.8662491810000006, 2024-09-18T10:31:39.313 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001995953, 2024-09-18T10:31:39.313 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.313 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.313 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.313 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.314 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.314 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401920+0000", 2024-09-18T10:31:39.314 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.314 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.314 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.315 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401920+0000", 2024-09-18T10:31:39.315 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.315 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.315 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401919+0000", 2024-09-18T10:31:39.316 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.316 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.316 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.316 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.316 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401929+0000", 2024-09-18T10:31:39.316 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5070000000000006e-06 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401939+0000", 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0190000000000001e-05 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.317 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401944+0000", 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5990000000000004e-06 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401986+0000", 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2623000000000002e-05 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.318 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.401992+0000", 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7209999999999999e-06 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.403889+0000", 2024-09-18T10:31:39.319 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001897375 2024-09-18T10:31:39.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.320 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.320 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.320 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.403916+0000", 2024-09-18T10:31:39.320 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6563999999999998e-05 2024-09-18T10:31:39.321 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.321 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.321 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.321 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.321 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 45/33 ECSubWrite(tid=141, reqid=client.4589.0:317, at_version=45'27, trim_to=0'0, roll_forward_to=45'25))", 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:30.406858+0000", 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.8613113529999996, 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0029938170000000002, 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406858+0000", 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.322 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406858+0000", 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406857+0000", 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406873+0000", 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6256000000000002e-05 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.323 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406885+0000", 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1759e-05 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406896+0000", 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0845999999999999e-05 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406933+0000", 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6860999999999998e-05 2024-09-18T10:31:39.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.325 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.325 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.325 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.406943+0000", 2024-09-18T10:31:39.325 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6840000000000008e-06 2024-09-18T10:31:39.325 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.325 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.409827+0000", 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0028842080000000001 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.326 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.409852+0000", 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4828e-05 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.327 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6728107200000002, 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039367780000000002, 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.328 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:39.329 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.330 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.331 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.331 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595367+0000", 2024-09-18T10:31:39.331 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6660000000000003e-06 2024-09-18T10:31:39.331 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.331 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.331 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.332 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595378+0000", 2024-09-18T10:31:39.332 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0883999999999999e-05 2024-09-18T10:31:39.332 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.332 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.332 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.333 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595384+0000", 2024-09-18T10:31:39.333 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5659999999999997e-06 2024-09-18T10:31:39.333 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.333 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.333 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595422+0000", 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8557999999999999e-05 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595434+0000", 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1573000000000001e-05 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599270+0000", 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038357019999999999 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.334 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599295+0000", 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5622999999999998e-05 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=29, reqid=client.4589.0:366, at_version=49'20, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6720840739999998, 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003225169, 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.335 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.336 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596108+0000", 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2972e-05 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596119+0000", 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1358e-05 2024-09-18T10:31:39.337 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596126+0000", 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6649999999999997e-06 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596172+0000", 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6372999999999998e-05 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596181+0000", 2024-09-18T10:31:39.338 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8610000000000004e-06 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599298+0000", 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003117159 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599310+0000", 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2014999999999999e-05 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.339 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 49/33 ECSubWrite(tid=40, reqid=osd.3.0:40, at_version=49'29, trim_to=0'0, roll_forward_to=48'27))", 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.596332+0000", 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.671837461, 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002973355, 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596332+0000", 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.340 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596332+0000", 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596331+0000", 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596350+0000", 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8600000000000001e-05 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.341 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596359+0000", 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2129999999999997e-06 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596365+0000", 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4600000000000002e-06 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596411+0000", 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6693999999999997e-05 2024-09-18T10:31:39.342 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596420+0000", 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3299999999999999e-06 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599278+0000", 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0028583250000000001 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.343 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599305+0000", 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6931999999999999e-05 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 49/33 ECSubWrite(tid=41, reqid=osd.3.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=49'29))", 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6641367819999999, 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056101689999999999, 2024-09-18T10:31:39.344 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.345 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604042+0000", 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0319999999999999e-05 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604052+0000", 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6830000000000003e-06 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.346 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2500000000000003e-06 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604104+0000", 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5391e-05 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.347 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.348 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.348 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604112+0000", 2024-09-18T10:31:39.348 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6780000000000006e-06 2024-09-18T10:31:39.348 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.348 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.348 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609618+0000", 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055057309999999998 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609643+0000", 2024-09-18T10:31:39.349 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4572000000000001e-05 2024-09-18T10:31:39.350 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.350 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.350 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.350 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.350 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.350 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 49/33 ECSubWrite(tid=169, reqid=osd.4.0:168, at_version=0'0, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6637328499999997, 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051417169999999996, 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.351 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.352 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.352 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:31:39.352 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.352 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.352 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.352 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.353 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:31:39.353 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.353 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.353 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.353 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.353 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604435+0000", 2024-09-18T10:31:39.354 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.354 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.354 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.354 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.354 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604448+0000", 2024-09-18T10:31:39.354 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2131e-05 2024-09-18T10:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604459+0000", 2024-09-18T10:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1649e-05 2024-09-18T10:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.356 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.356 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.356 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604466+0000", 2024-09-18T10:31:39.356 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4799999999999998e-06 2024-09-18T10:31:39.356 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.356 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.357 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604513+0000", 2024-09-18T10:31:39.357 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7036999999999997e-05 2024-09-18T10:31:39.357 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.357 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604523+0000", 2024-09-18T10:31:39.358 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0118999999999999e-05 2024-09-18T10:31:39.358 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.358 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.358 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.359 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609552+0000", 2024-09-18T10:31:39.359 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050292749999999997 2024-09-18T10:31:39.359 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.359 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.359 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.359 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609578+0000", 2024-09-18T10:31:39.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5811000000000001e-05 2024-09-18T10:31:39.360 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.360 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.360 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.360 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.360 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=31, reqid=osd.8.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6635987100000005, 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055933889999999998, 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.361 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:31:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.363 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.363 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:31:39.363 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.363 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.363 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.363 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.364 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604569+0000", 2024-09-18T10:31:39.364 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.364 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.364 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.364 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.365 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604584+0000", 2024-09-18T10:31:39.365 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5183e-05 2024-09-18T10:31:39.365 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.365 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.365 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.365 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604599+0000", 2024-09-18T10:31:39.366 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4738e-05 2024-09-18T10:31:39.366 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.366 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.366 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.366 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604606+0000", 2024-09-18T10:31:39.366 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8390000000000001e-06 2024-09-18T10:31:39.367 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.367 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.367 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.367 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604658+0000", 2024-09-18T10:31:39.367 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2009000000000003e-05 2024-09-18T10:31:39.367 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604667+0000", 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4269999999999997e-06 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610148+0000", 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054800889999999996 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.368 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610164+0000", 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6271999999999999e-05 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6613388889999996, 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054572869999999999, 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.369 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606829+0000", 2024-09-18T10:31:39.370 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606859+0000", 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9223000000000001e-05 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606874+0000", 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.371 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606880+0000", 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5400000000000001e-06 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606942+0000", 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1527999999999998e-05 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606952+0000", 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0139999999999999e-05 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.372 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612246+0000", 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052944999999999997 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612288+0000", 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1016000000000002e-05 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=32, reqid=client.4589.0:367, at_version=49'24, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:31:39.373 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6606677200000002, 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051511930000000001, 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.374 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607667+0000", 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000166269 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607677+0000", 2024-09-18T10:31:39.375 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.397e-06 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607681+0000", 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2139999999999998e-06 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607714+0000", 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3355999999999997e-05 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.376 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607723+0000", 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9719999999999998e-06 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612630+0000", 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049068009999999997 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612653+0000", 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2731999999999999e-05 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.377 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=33, reqid=client.4589.0:367, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.613322+0000", 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.6548473030000004, 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027829399999999998, 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613322+0000", 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.378 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613322+0000", 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613321+0000", 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.379 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613331+0000", 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.006e-05 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613342+0000", 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0657e-05 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613350+0000", 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8620000000000003e-06 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613398+0000", 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8075999999999998e-05 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.613411+0000", 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3383999999999999e-05 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.616087+0000", 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002675462 2024-09-18T10:31:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.616105+0000", 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8070000000000001e-05 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 54/33 ECSubWrite(tid=51, reqid=client.4589.0:414, at_version=54'39, trim_to=0'0, roll_forward_to=53'36))", 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.632937+0000", 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 0.63523182099999997, 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0026006860000000001, 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632937+0000", 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632937+0000", 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632937+0000", 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632955+0000", 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8519999999999999e-05 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632967+0000", 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1960000000000001e-05 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632977+0000", 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6320000000000003e-06 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633019+0000", 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2685000000000002e-05 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633028+0000", 2024-09-18T10:31:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.7309999999999999e-06 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.635513+0000", 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024845639999999999 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.635538+0000", 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5221000000000001e-05 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 54/33 ECSubWrite(tid=37, reqid=client.4589.0:416, at_version=54'30, trim_to=0'0, roll_forward_to=53'28))", 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.646112+0000", 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 0.622057152, 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002414416, 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646112+0000", 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646112+0000", 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646112+0000", 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646704+0000", 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00059207300000000004 2024-09-18T10:31:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646720+0000", 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6308e-05 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646728+0000", 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2050000000000002e-06 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646779+0000", 2024-09-18T10:31:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.0457000000000002e-05 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.646788+0000", 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0219999999999993e-06 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.648502+0000", 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001714218 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.648526+0000", 2024-09-18T10:31:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4406e-05 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 54/33 ECSubWrite(tid=40, reqid=client.4589.0:419, at_version=54'33, trim_to=0'0, roll_forward_to=54'31))", 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 0.615394899, 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0033514149999999999, 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652790+0000", 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5953000000000001e-05 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652798+0000", 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6780000000000006e-06 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652802+0000", 2024-09-18T10:31:39.393 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.873e-06 2024-09-18T10:31:39.394 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.394 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.394 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.394 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652848+0000", 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5626e-05 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652855+0000", 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.452e-06 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.396 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.656106+0000", 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032503480000000001 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.656126+0000", 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0071000000000001e-05 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.397 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.399 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:39.399 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:39.398+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:39.497 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.497 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:39.497 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:39.497 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.500 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:39.498+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:39.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:39.601 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:39.600+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:39.603 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.603 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:39.603 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:39.603 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:39.603 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:39.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:31:39.628 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.8 to 1 (10000) 2024-09-18T10:31:39.629 INFO:tasks.rados.rados.0.smithi160.stdout:162: done (3 left) 2024-09-18T10:31:39.629 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 38 current snap is 11 2024-09-18T10:31:39.630 INFO:tasks.rados.rados.0.smithi160.stdout:163: seq_num 89 ranges {2965504=737280,3702784=573440,4276224=196608} 2024-09-18T10:31:39.645 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-18T10:31:39.649 INFO:tasks.rados.rados.0.smithi160.stdout:163: writing smithi16036501-38 from 2965504 to 3702784 tid 1 2024-09-18T10:31:39.653 INFO:tasks.rados.rados.0.smithi160.stdout:163: writing smithi16036501-38 from 3702784 to 4276224 tid 2 2024-09-18T10:31:39.655 INFO:tasks.rados.rados.0.smithi160.stdout:163: writing smithi16036501-38 from 4276224 to 4472832 tid 3 2024-09-18T10:31:39.655 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 16 current snap is 11 2024-09-18T10:31:39.655 INFO:tasks.rados.rados.0.smithi160.stdout:164: seq_num 90 ranges {1327104=753664,2080768=720896,2801664=49152} 2024-09-18T10:31:39.666 INFO:tasks.rados.rados.0.smithi160.stdout:164: writing smithi16036501-16 from 1327104 to 2080768 tid 1 2024-09-18T10:31:39.670 INFO:tasks.rados.rados.0.smithi160.stdout:164: writing smithi16036501-16 from 2080768 to 2801664 tid 2 2024-09-18T10:31:39.671 INFO:tasks.rados.rados.0.smithi160.stdout:164: writing smithi16036501-16 from 2801664 to 2850816 tid 3 2024-09-18T10:31:39.671 INFO:tasks.rados.rados.0.smithi160.stdout:165: setattr oid 1 current snap is 11 2024-09-18T10:31:39.671 INFO:tasks.rados.rados.0.smithi160.stdout:160: finishing rollback tid 0 to smithi16036501-28 2024-09-18T10:31:39.671 INFO:tasks.rados.rados.0.smithi160.stdout:160: finishing rollback tid 1 to smithi16036501-28 2024-09-18T10:31:39.671 INFO:tasks.rados.rados.0.smithi160.stdout:160: finishing rollback tid 2 to smithi16036501-28 2024-09-18T10:31:39.671 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 28 v 40 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-18T10:31:39.672 INFO:tasks.rados.rados.0.smithi160.stdout:159: expect (ObjNum 62 snap 3 seq_num 62) 2024-09-18T10:31:39.702 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:39.701+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:39.711 INFO:tasks.rados.rados.0.smithi160.stdout:161: finishing write tid 1 to smithi16036501-32 2024-09-18T10:31:39.711 INFO:tasks.rados.rados.0.smithi160.stdout:161: finishing write tid 2 to smithi16036501-32 2024-09-18T10:31:39.711 INFO:tasks.rados.rados.0.smithi160.stdout:161: finishing write tid 3 to smithi16036501-32 2024-09-18T10:31:39.711 INFO:tasks.rados.rados.0.smithi160.stdout:161: finishing write tid 4 to smithi16036501-32 2024-09-18T10:31:39.711 INFO:tasks.rados.rados.0.smithi160.stdout:161: finishing write tid 5 to smithi16036501-32 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 32 v 33 (ObjNum 88 snap 11 seq_num 88) dirty exists 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:161: left oid 32 (ObjNum 88 snap 11 seq_num 88) 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:163: finishing write tid 1 to smithi16036501-38 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:163: finishing write tid 2 to smithi16036501-38 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:163: finishing write tid 3 to smithi16036501-38 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:163: finishing write tid 4 to smithi16036501-38 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:163: finishing write tid 5 to smithi16036501-38 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 47 (ObjNum 89 snap 11 seq_num 89) dirty exists 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:163: left oid 38 (ObjNum 89 snap 11 seq_num 89) 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:164: finishing write tid 1 to smithi16036501-16 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:164: finishing write tid 2 to smithi16036501-16 2024-09-18T10:31:39.712 INFO:tasks.rados.rados.0.smithi160.stdout:164: finishing write tid 3 to smithi16036501-16 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:164: finishing write tid 4 to smithi16036501-16 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:164: finishing write tid 5 to smithi16036501-16 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 52 (ObjNum 90 snap 11 seq_num 90) dirty exists 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:164: left oid 16 (ObjNum 90 snap 11 seq_num 90) 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:159: done (5 left) 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:160: done (4 left) 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:161: done (3 left) 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:163: done (2 left) 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:164: done (1 left) 2024-09-18T10:31:39.713 INFO:tasks.rados.rados.0.smithi160.stdout:166: read oid 31 snap -1 2024-09-18T10:31:39.714 INFO:tasks.rados.rados.0.smithi160.stdout:166: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:31:39.714 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 3 current snap is 11 2024-09-18T10:31:39.714 INFO:tasks.rados.rados.0.smithi160.stdout:167: seq_num 91 ranges {1376256=770048,2146304=475136,2621440=294912} 2024-09-18T10:31:39.722 INFO:tasks.rados.rados.0.smithi160.stdout:167: writing smithi16036501-3 from 1376256 to 2146304 tid 1 2024-09-18T10:31:39.724 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.724 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:39.724 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:39.725 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:39.725 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.725 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/33 ECSubWrite(tid=54, reqid=client.4589.0:199, at_version=38'18, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:39.725 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.277755+0000", 2024-09-18T10:31:39.725 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.444161805, 2024-09-18T10:31:39.725 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049367650000000001, 2024-09-18T10:31:39.726 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.726 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.726 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.726 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.726 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.726 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.277755+0000", 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.277755+0000", 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.727 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.277755+0000", 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278523+0000", 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076829199999999995 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.728 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278543+0000", 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9528e-05 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278564+0000", 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1228000000000001e-05 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.729 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278649+0000", 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5381000000000001e-05 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.278666+0000", 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6682000000000001e-05 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.282625+0000", 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039592840000000004 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.730 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.282692+0000", 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6573000000000001e-05 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/33 ECSubWrite(tid=55, reqid=client.4589.0:200, at_version=38'19, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.442355489000001, 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059624359999999998, 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.731 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279560+0000", 2024-09-18T10:31:39.732 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279841+0000", 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00028120800000000002 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279869+0000", 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7813e-05 2024-09-18T10:31:39.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.734 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.734 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.734 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279894+0000", 2024-09-18T10:31:39.734 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4644e-05 2024-09-18T10:31:39.734 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.734 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279949+0000", 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5003999999999997e-05 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279959+0000", 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0149999999999999e-05 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285495+0000", 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055354640000000004 2024-09-18T10:31:39.735 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285524+0000", 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9268000000000002e-05 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/33 ECSubWrite(tid=56, reqid=client.4589.0:201, at_version=38'20, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.280375+0000", 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.441542129999998, 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051644849999999999, 2024-09-18T10:31:39.736 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280375+0000", 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280375+0000", 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.737 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280374+0000", 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280395+0000", 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0894999999999999e-05 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280413+0000", 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7917000000000001e-05 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.738 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280421+0000", 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.542e-06 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280639+0000", 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00021878699999999999 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.280649+0000", 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.006e-05 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.739 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285528+0000", 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0048791240000000003 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285539+0000", 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0736e-05 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.740 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/33 ECSubWrite(tid=77, reqid=client.4589.0:211, at_version=39'16, trim_to=0'0, roll_forward_to=36'14))", 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.285553+0000", 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.436364072, 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051995009999999996, 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.741 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285553+0000", 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285553+0000", 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285552+0000", 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.286058+0000", 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050504100000000002 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.286070+0000", 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2072999999999999e-05 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.286077+0000", 2024-09-18T10:31:39.743 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6429999999999995e-06 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.286146+0000", 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9145000000000003e-05 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.286157+0000", 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0917000000000001e-05 2024-09-18T10:31:39.744 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.290724+0000", 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0045671669999999996 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.290752+0000", 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7803000000000001e-05 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.745 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/33 ECSubWrite(tid=78, reqid=client.4589.0:212, at_version=39'17, trim_to=0'0, roll_forward_to=36'14))", 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.288089+0000", 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.433828095000001, 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042124720000000001, 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.746 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.288089+0000", 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.288089+0000", 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.288088+0000", 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.288307+0000", 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00021880200000000001 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.748 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.288320+0000", 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3397999999999999e-05 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.288327+0000", 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2259999999999999e-06 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289509+0000", 2024-09-18T10:31:39.749 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0011820050000000001 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289519+0000", 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.8290000000000003e-06 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.292275+0000", 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027560309999999999 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.750 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.292301+0000", 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6208999999999999e-05 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 39/33 ECSubWrite(tid=79, reqid=client.4589.0:213, at_version=39'18, trim_to=0'0, roll_forward_to=36'14))", 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.289025+0000", 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.43289165, 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032919709999999999, 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.751 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289025+0000", 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289025+0000", 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.752 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289025+0000", 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289043+0000", 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8082999999999999e-05 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289053+0000", 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0403e-05 2024-09-18T10:31:39.753 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.289059+0000", 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7939999999999999e-06 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.290328+0000", 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0012691410000000001 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.754 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.290337+0000", 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4760000000000004e-06 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.292310+0000", 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0019725889999999999 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.292317+0000", 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1199999999999996e-06 2024-09-18T10:31:39.755 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.756 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.756 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.756 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.756 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.756 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 44/33 ECSubWrite(tid=114, reqid=osd.4.0:114, at_version=44'28, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.313762+0000", 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.408154476, 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052739479999999997, 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.757 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.758 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.758 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313762+0000", 2024-09-18T10:31:39.758 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.758 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.758 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.758 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.759 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313762+0000", 2024-09-18T10:31:39.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.759 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.759 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.759 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313761+0000", 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313799+0000", 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7222999999999999e-05 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.760 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.761 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313818+0000", 2024-09-18T10:31:39.761 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9780999999999999e-05 2024-09-18T10:31:39.761 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.761 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.761 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313826+0000", 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6890000000000004e-06 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313881+0000", 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4407999999999998e-05 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313890+0000", 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1540000000000008e-06 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.762 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318991+0000", 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051016020000000002 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319036+0000", 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5027000000000001e-05 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.40733507, 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006943187, 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.764 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314581+0000", 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.765 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314602+0000", 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0686000000000002e-05 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314615+0000", 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3169e-05 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.766 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.767 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.767 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314622+0000", 2024-09-18T10:31:39.767 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9539999999999998e-06 2024-09-18T10:31:39.767 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.767 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314668+0000", 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6242000000000002e-05 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314678+0000", 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5489999999999995e-06 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.768 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321509+0000", 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006831709 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321525+0000", 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5611e-05 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.769 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.317515+0000", 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.404401886, 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032689220000000001, 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317515+0000", 2024-09-18T10:31:39.770 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317515+0000", 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317514+0000", 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.771 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317526+0000", 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2152e-05 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317538+0000", 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1719000000000001e-05 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317544+0000", 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.772 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317586+0000", 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1579000000000003e-05 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.317593+0000", 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2579999999999998e-06 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320756+0000", 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0031631810000000002 2024-09-18T10:31:39.773 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320784+0000", 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7504999999999998e-05 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 44/33 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=44'28, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.318269+0000", 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.403647485, 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038301839999999999, 2024-09-18T10:31:39.774 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318269+0000", 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318269+0000", 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.775 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318268+0000", 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318292+0000", 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3870999999999999e-05 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318309+0000", 2024-09-18T10:31:39.776 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.626e-05 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318315+0000", 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.613e-06 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.777 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318366+0000", 2024-09-18T10:31:39.778 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.0822000000000002e-05 2024-09-18T10:31:39.778 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318374+0000", 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9910000000000002e-06 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322068+0000", 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036938539999999999 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.779 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322100+0000", 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1705000000000002e-05 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s2 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.321350+0000", 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.40056673, 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0035533850000000001, 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.780 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321350+0000", 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321350+0000", 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321349+0000", 2024-09-18T10:31:39.781 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321374+0000", 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4468999999999999e-05 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321389+0000", 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4979e-05 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.782 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321396+0000", 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2649999999999999e-06 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321454+0000", 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8689e-05 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321465+0000", 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0139999999999999e-05 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.783 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324865+0000", 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034000359999999999 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324904+0000", 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8868999999999997e-05 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.784 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 44/33 ECSubWrite(tid=124, reqid=osd.4.0:115, at_version=0'0, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.326441+0000", 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.395475561, 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0043981920000000004, 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326441+0000", 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.785 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326441+0000", 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326440+0000", 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326455+0000", 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.45e-05 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.786 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326468+0000", 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2627e-05 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326475+0000", 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6590000000000007e-06 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326533+0000", 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8242000000000002e-05 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326544+0000", 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0574000000000001e-05 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.788 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330667+0000", 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041228599999999999 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330839+0000", 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00017256300000000001 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:31:39.789 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:30.345436+0000", 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.3764810000000001, 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024717160000000001, 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345436+0000", 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345436+0000", 2024-09-18T10:31:39.790 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345435+0000", 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345519+0000", 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4387000000000004e-05 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.791 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345530+0000", 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0504e-05 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345536+0000", 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.691e-06 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345578+0000", 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1136000000000001e-05 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.792 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.345588+0000", 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0542e-05 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.347881+0000", 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002293308 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.347908+0000", 2024-09-18T10:31:39.793 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6197999999999999e-05 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.5s6 49/33 ECSubWrite(tid=62, reqid=osd.5.0:61, at_version=0'0, trim_to=0'0, roll_forward_to=49'16))", 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.594889+0000", 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.1270279179999996, 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041153309999999999, 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.794 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594889+0000", 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594889+0000", 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594888+0000", 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.795 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594899+0000", 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0616e-05 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594913+0000", 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3769e-05 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594920+0000", 2024-09-18T10:31:39.796 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2289999999999997e-06 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594977+0000", 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.753e-05 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.594987+0000", 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9599999999999995e-06 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.797 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598982+0000", 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039950369999999999 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599004+0000", 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1849e-05 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:39.798 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597358+0000", 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.1245586489999999, 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002885931, 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597358+0000", 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.799 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597358+0000", 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597358+0000", 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597382+0000", 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3665000000000001e-05 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.800 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597391+0000", 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3810000000000005e-06 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597397+0000", 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7379999999999999e-06 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597448+0000", 2024-09-18T10:31:39.801 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.0927999999999998e-05 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597460+0000", 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2432000000000001e-05 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.600212+0000", 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027522229999999998 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.802 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.600244+0000", 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1874e-05 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 49/33 ECSubWrite(tid=167, reqid=osd.4.0:167, at_version=49'41, trim_to=0'0, roll_forward_to=47'39))", 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.598789+0000", 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.12312747, 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0037941009999999998, 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.803 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598789+0000", 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598789+0000", 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598789+0000", 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.804 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598806+0000", 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6960999999999999e-05 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598818+0000", 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1554e-05 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598824+0000", 2024-09-18T10:31:39.805 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3969999999999999e-06 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598882+0000", 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7540000000000001e-05 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.598892+0000", 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0040999999999999e-05 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.806 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602557+0000", 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036652109999999998 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602583+0000", 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6571e-05 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 49/33 ECSubWrite(tid=170, reqid=osd.4.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604494+0000", 2024-09-18T10:31:39.807 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.117423198, 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051052069999999996, 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604494+0000", 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604494+0000", 2024-09-18T10:31:39.808 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604493+0000", 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604503+0000", 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0328e-05 2024-09-18T10:31:39.809 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.810 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.810 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.810 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604517+0000", 2024-09-18T10:31:39.810 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3752e-05 2024-09-18T10:31:39.810 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.811 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.811 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.811 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604523+0000", 2024-09-18T10:31:39.811 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0220000000000001e-06 2024-09-18T10:31:39.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.811 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.812 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.812 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604563+0000", 2024-09-18T10:31:39.812 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0219999999999998e-05 2024-09-18T10:31:39.812 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.812 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.813 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.813 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604572+0000", 2024-09-18T10:31:39.813 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.473e-06 2024-09-18T10:31:39.813 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.813 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.813 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.814 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609581+0000", 2024-09-18T10:31:39.814 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050094199999999997 2024-09-18T10:31:39.814 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.814 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.815 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.815 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609599+0000", 2024-09-18T10:31:39.815 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7799999999999999e-05 2024-09-18T10:31:39.815 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.815 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 49/33 ECSubWrite(tid=171, reqid=osd.4.0:171, at_version=49'39, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.606099+0000", 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.1158176070000003, 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034740909999999999, 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.816 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606099+0000", 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.817 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606099+0000", 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606099+0000", 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606143+0000", 2024-09-18T10:31:39.818 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3927999999999997e-05 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606156+0000", 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3536000000000001e-05 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606178+0000", 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2303999999999999e-05 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.819 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606223+0000", 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5132000000000001e-05 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606230+0000", 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.579e-06 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609548+0000", 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00331825 2024-09-18T10:31:39.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609573+0000", 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5035e-05 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.607003+0000", 2024-09-18T10:31:39.821 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.1149137810000003, 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053419729999999999, 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607003+0000", 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607003+0000", 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.822 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607002+0000", 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607022+0000", 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9411000000000001e-05 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607035+0000", 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2914999999999999e-05 2024-09-18T10:31:39.823 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607044+0000", 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6940000000000007e-06 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607090+0000", 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5819000000000003e-05 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.824 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607100+0000", 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4939999999999992e-06 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612321+0000", 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052213529999999998 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612345+0000", 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3964e-05 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.825 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 49/33 ECSubWrite(tid=95, reqid=client.4589.0:361, at_version=0'0, trim_to=0'0, roll_forward_to=49'35))", 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.607934+0000", 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.1139832910000003, 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004462929, 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:39.826 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607934+0000", 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607934+0000", 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607933+0000", 2024-09-18T10:31:39.827 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607942+0000", 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6000000000000007e-06 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607952+0000", 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0929e-05 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.828 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607962+0000", 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1730000000000001e-06 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.608003+0000", 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1418999999999998e-05 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:39.829 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.608012+0000", 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3079999999999997e-06 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612372+0000", 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0043599499999999996 2024-09-18T10:31:39.830 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612396+0000", 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4151e-05 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:39.831 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:39.832 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.833 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:39.832+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:167: writing smithi16036501-3 from 2146304 to 2621440 tid 2 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:167: writing smithi16036501-3 from 2621440 to 2916352 tid 3 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:168: read oid 37 snap 7 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:168: expect (ObjNum 42 snap 0 seq_num 42) 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:169: read oid 12 snap -1 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:169: expect deleted 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:170: rollback oid 14 current snap is 11 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 14 to 3 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 1 v 50 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-18T10:31:39.834 INFO:tasks.rados.rados.0.smithi160.stdout:166: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:31:39.835 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:167: finishing write tid 1 to smithi16036501-3 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:168: expect (ObjNum 42 snap 0 seq_num 42) 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:170: finishing rollback tid 0 to smithi16036501-14 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:167: finishing write tid 2 to smithi16036501-3 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:167: finishing write tid 3 to smithi16036501-3 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:167: finishing write tid 4 to smithi16036501-3 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:170: finishing rollback tid 1 to smithi16036501-14 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:167: finishing write tid 5 to smithi16036501-3 2024-09-18T10:31:39.837 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 3 v 23 (ObjNum 91 snap 11 seq_num 91) dirty exists 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:167: left oid 3 (ObjNum 91 snap 11 seq_num 91) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:170: finishing rollback tid 2 to smithi16036501-14 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 14 v 56 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:165: done (5 left) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:166: done (4 left) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:167: done (3 left) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:168: done (2 left) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:169: done (1 left) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:170: done (0 left) 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 19 current snap is 11 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:171: seq_num 92 ranges {2473984=786432,3260416=491520,3751936=278528} 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:171: writing smithi16036501-19 from 2473984 to 3260416 tid 1 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:171: writing smithi16036501-19 from 3260416 to 3751936 tid 2 2024-09-18T10:31:39.838 INFO:tasks.rados.rados.0.smithi160.stdout:171: writing smithi16036501-19 from 3751936 to 4030464 tid 3 2024-09-18T10:31:39.839 INFO:tasks.rados.rados.0.smithi160.stdout:172: snap_remove snap 9 2024-09-18T10:31:39.934 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:39.933+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:39.974 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:39.974 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:39.974 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:39.974 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:39.982 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:31:40.035 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:40.034+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:40.120 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:40.120 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:40.120 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:40.120 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:40.121 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:40.129 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:31:40.172 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:40.171+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:41 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'23, mlcod=24'19)", 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.230947346000001, 2024-09-18T10:31:40.229 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055352270000000002, 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.230 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996042+0000", 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996105+0000", 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3058999999999994e-05 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996120+0000", 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4555999999999999e-05 2024-09-18T10:31:40.231 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996126+0000", 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1550000000000004e-06 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996159+0000", 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3147e-05 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.232 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996172+0000", 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2802e-05 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001546+0000", 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053743339999999997 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.233 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001578+0000", 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1952000000000002e-05 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:42 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'24, mlcod=24'19)", 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.230491098999998, 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050999269999999998, 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.234 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:40.235 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996515+0000", 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6300999999999999e-05 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996523+0000", 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.1079999999999993e-06 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.236 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996532+0000", 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5059999999999995e-06 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996567+0000", 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5596999999999998e-05 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996587+0000", 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9828999999999999e-05 2024-09-18T10:31:40.237 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001580+0000", 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049931979999999999 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001599+0000", 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8725000000000001e-05 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.238 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:50 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'32, mlcod=24'21)", 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.225977821000001, 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058482279999999996, 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.239 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001012+0000", 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001087+0000", 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5179999999999995e-05 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001097+0000", 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0253e-05 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001105+0000", 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9410000000000007e-06 2024-09-18T10:31:40.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001141+0000", 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5515999999999997e-05 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001162+0000", 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0917999999999999e-05 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006825+0000", 2024-09-18T10:31:40.242 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056635110000000004 2024-09-18T10:31:40.243 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.243 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.243 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.243 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006861+0000", 2024-09-18T10:31:40.243 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5673000000000002e-05 2024-09-18T10:31:40.243 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:51 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'33, mlcod=24'21)", 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.225433977999998, 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053261339999999997, 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.244 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001563+0000", 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1199999999999996e-06 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001574+0000", 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1612e-05 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001580+0000", 2024-09-18T10:31:40.246 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4779999999999999e-06 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001721+0000", 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000141409 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001735+0000", 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3767999999999999e-05 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.247 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006863+0000", 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051274720000000001 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006883+0000", 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0006000000000001e-05 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:52 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'34, mlcod=24'21)", 2024-09-18T10:31:40.248 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.225056727999998, 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049710359999999999, 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:40.249 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001933+0000", 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001939+0000", 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2859999999999996e-06 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.250 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001948+0000", 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6559999999999998e-06 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001952+0000", 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6239999999999999e-06 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001986+0000", 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4764000000000001e-05 2024-09-18T10:31:40.251 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.002005+0000", 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8576e-05 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006885+0000", 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004879904 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.252 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006905+0000", 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9792e-05 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:71 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'49, mlcod=25'45)", 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:40.253 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.093184033999997, 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060683170000000002, 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.254 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133811+0000", 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4179999999999996e-06 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133820+0000", 2024-09-18T10:31:40.255 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9050000000000003e-06 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133824+0000", 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3969999999999998e-06 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133864+0000", 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0028999999999999e-05 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.256 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133883+0000", 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9049e-05 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139840+0000", 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059569510000000003 2024-09-18T10:31:40.257 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.260 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.260 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.260 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139875+0000", 2024-09-18T10:31:40.260 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5117000000000003e-05 2024-09-18T10:31:40.260 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.260 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:72 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'50, mlcod=25'45)", 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.092775742000001, 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056771290000000004, 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.261 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134214+0000", 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.262 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134252+0000", 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7412e-05 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134261+0000", 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134271+0000", 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0716999999999999e-05 2024-09-18T10:31:40.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134305+0000", 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4031e-05 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134325+0000", 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9318e-05 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.264 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139878+0000", 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055528139999999997 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139892+0000", 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4192999999999999e-05 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:73 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'51, mlcod=25'45)", 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:40.265 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.092260156999998, 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051763119999999998, 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:40.266 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134734+0000", 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1500000000000001e-06 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.267 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134741+0000", 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5420000000000002e-06 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134744+0000", 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9699999999999999e-06 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136224+0000", 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001480234 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.268 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136236+0000", 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2357e-05 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139893+0000", 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036565059999999999 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139907+0000", 2024-09-18T10:31:40.269 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3910999999999999e-05 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:75 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'53, mlcod=25'45)", 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.091507475999997, 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070322270000000003, 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.271 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135546+0000", 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3405999999999996e-05 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135554+0000", 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5780000000000001e-06 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135557+0000", 2024-09-18T10:31:40.272 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.912e-06 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136700+0000", 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00114241 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136711+0000", 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1445e-05 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.273 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142483+0000", 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057715509999999998 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142515+0000", 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2313e-05 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:76 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'54, mlcod=25'45)", 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:40.274 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.090910624999999, 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091963210000000004, 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.275 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136079+0000", 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136090+0000", 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0294e-05 2024-09-18T10:31:40.276 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136096+0000", 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5549999999999999e-06 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136099+0000", 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1650000000000002e-06 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.277 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139649+0000", 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0035492869999999999 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139663+0000", 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4232e-05 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145234+0000", 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055716799999999999 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.278 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145276+0000", 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1618e-05 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:79 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'57, mlcod=25'53)", 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.079885916000002, 2024-09-18T10:31:40.279 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057630829999999996, 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.280 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147180+0000", 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6073000000000002e-05 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.281 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147189+0000", 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4460000000000001e-06 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147192+0000", 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6349999999999999e-06 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147225+0000", 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3318000000000002e-05 2024-09-18T10:31:40.282 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147240+0000", 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4397e-05 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152821+0000", 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005580616 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.283 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152868+0000", 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7043999999999999e-05 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:80 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'58, mlcod=25'53)", 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.079461635000001, 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053579960000000003, 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.284 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.285 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147528+0000", 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147600+0000", 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2118000000000003e-05 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147609+0000", 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8189999999999998e-06 2024-09-18T10:31:40.286 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147613+0000", 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8410000000000002e-06 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147643+0000", 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0179999999999999e-05 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.287 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147656+0000", 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2843999999999999e-05 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152871+0000", 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052145810000000003 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152887+0000", 2024-09-18T10:31:40.288 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6124e-05 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.947335533, 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055838909999999997, 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.289 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:40.290 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280401+0000", 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074599499999999995 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280415+0000", 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4711e-05 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280422+0000", 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6209999999999998e-06 2024-09-18T10:31:40.291 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280486+0000", 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3670999999999994e-05 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280494+0000", 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8599999999999993e-06 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.292 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285203+0000", 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047090980000000001 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285239+0000", 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6112999999999998e-05 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.293 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.913624187, 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050229960000000001, 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.294 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313389+0000", 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3708000000000001e-05 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.295 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313401+0000", 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1531e-05 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313408+0000", 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1029999999999996e-06 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313454+0000", 2024-09-18T10:31:40.296 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6489999999999997e-05 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313463+0000", 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318360+0000", 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0048972959999999998 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.297 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318389+0000", 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8866000000000001e-05 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s4 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 10.904358598, 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056939590000000002, 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.298 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322631+0000", 2024-09-18T10:31:40.299 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322653+0000", 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1883e-05 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322665+0000", 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2434e-05 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.300 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322672+0000", 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1799999999999999e-06 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322722+0000", 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9963999999999998e-05 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322730+0000", 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0859999999999996e-06 2024-09-18T10:31:40.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328297+0000", 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005567326 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328326+0000", 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8915e-05 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.302 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s1 49/33 ECSubWrite(tid=29, reqid=client.4589.0:366, at_version=49'20, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.6296723029999995, 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053532370000000003, 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.303 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597340+0000", 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1817000000000001e-05 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.304 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597348+0000", 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5040000000000002e-06 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597354+0000", 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7300000000000002e-06 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597400+0000", 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6319000000000002e-05 2024-09-18T10:31:40.305 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597410+0000", 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6339999999999996e-06 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602646+0000", 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005235707 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.306 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602671+0000", 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5683000000000001e-05 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 49/33 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=49'50, trim_to=0'0, roll_forward_to=47'48))", 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.6296300639999997, 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053254119999999999, 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.307 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.308 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597379+0000", 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8964999999999999e-05 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597387+0000", 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3890000000000005e-06 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.309 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597394+0000", 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.669e-06 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597448+0000", 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3860999999999998e-05 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597457+0000", 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0070000000000003e-06 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.310 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602662+0000", 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052053289999999999 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602686+0000", 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3453000000000001e-05 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s1 49/33 ECSubWrite(tid=30, reqid=osd.8.0:30, at_version=49'22, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:40.311 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.6296250509999997, 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060374210000000003, 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.312 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597379+0000", 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3862999999999999e-05 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.313 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597387+0000", 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9149999999999996e-06 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597391+0000", 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8310000000000003e-06 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599813+0000", 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024224110000000002 2024-09-18T10:31:40.314 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599822+0000", 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8610000000000004e-06 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603383+0000", 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003560798 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603403+0000", 2024-09-18T10:31:40.315 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9915000000000002e-05 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.6294899019999995, 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0061865829999999998, 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.316 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.317 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597519+0000", 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8604e-05 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597527+0000", 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3760000000000008e-06 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597532+0000", 2024-09-18T10:31:40.318 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9779999999999996e-06 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597587+0000", 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4666000000000001e-05 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597597+0000", 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0448999999999999e-05 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.319 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603670+0000", 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060726390000000003 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603687+0000", 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7345000000000001e-05 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 49/33 ECSubWrite(tid=65, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:40.320 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604154+0000", 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.6228368460000002, 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054359229999999996, 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604154+0000", 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:40.321 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604154+0000", 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604153+0000", 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604162+0000", 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6659999999999997e-06 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.322 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604171+0000", 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6779999999999995e-06 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604177+0000", 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8300000000000001e-06 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604610+0000", 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00043294399999999999 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.323 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604619+0000", 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0219999999999993e-06 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609563+0000", 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049438700000000004 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609589+0000", 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6353e-05 2024-09-18T10:31:40.324 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.325 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.325 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.325 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:40.325 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:40.325 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:40.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:40.327 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:40.325+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:40.427 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:40.426+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:40.430 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:40.430 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:40.430 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:40.431 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:40.439 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:40.528 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:40.527+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:40.541 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:40.541 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:40.541 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:40.541 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:40.541 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:40.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:40.628 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:40.628+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:40.640 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:31:40.641 INFO:tasks.rados.rados.0.smithi160.stdout:172: done (1 left) 2024-09-18T10:31:40.641 INFO:tasks.rados.rados.0.smithi160.stdout:173: copy_from oid 3 from oid 23 current snap is 11 2024-09-18T10:31:40.641 INFO:tasks.rados.rados.0.smithi160.stdout:171: finishing write tid 1 to smithi16036501-19 2024-09-18T10:31:40.641 INFO:tasks.rados.rados.0.smithi160.stdout:171: finishing write tid 2 to smithi16036501-19 2024-09-18T10:31:40.641 INFO:tasks.rados.rados.0.smithi160.stdout:171: finishing write tid 3 to smithi16036501-19 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:171: finishing write tid 4 to smithi16036501-19 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:171: finishing write tid 5 to smithi16036501-19 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 35 (ObjNum 92 snap 11 seq_num 92) dirty exists 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:171: left oid 19 (ObjNum 92 snap 11 seq_num 92) 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:171: done (1 left) 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:174: rollback oid 39 current snap is 11 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 39 to 3 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:175: rmattr oid 11 current snap is 11 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:175: done (2 left) 2024-09-18T10:31:40.642 INFO:tasks.rados.rados.0.smithi160.stdout:176: delete oid 18 current snap is 11 2024-09-18T10:31:40.643 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.9 to 1 (10000) 2024-09-18T10:31:40.649 INFO:tasks.rados.rados.0.smithi160.stdout:174: finishing rollback tid 0 to smithi16036501-39 2024-09-18T10:31:40.650 INFO:tasks.rados.rados.0.smithi160.stdout:173: finishing copy_from racing read to smithi16036501-3 2024-09-18T10:31:40.651 INFO:tasks.rados.rados.0.smithi160.stdout:176: done (2 left) 2024-09-18T10:31:40.651 INFO:tasks.rados.rados.0.smithi160.stdout:177: snap_create 2024-09-18T10:31:40.651 INFO:tasks.rados.rados.0.smithi160.stdout:174: finishing rollback tid 1 to smithi16036501-39 2024-09-18T10:31:40.651 INFO:tasks.rados.rados.0.smithi160.stdout:174: finishing rollback tid 2 to smithi16036501-39 2024-09-18T10:31:40.651 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 39 v 60 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-18T10:31:40.656 INFO:tasks.rados.rados.0.smithi160.stdout:173: finishing copy_from to smithi16036501-3 2024-09-18T10:31:40.656 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 3 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-18T10:31:40.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-18T10:31:40.669 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:40.669 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:40.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:40.669 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:207 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~671744] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.392235686999999, 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011106883, 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.670 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 207 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274787+0000", 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999962 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275694+0000", 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090683300000000001 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275721+0000", 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6876000000000002e-05 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275732+0000", 2024-09-18T10:31:40.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1522000000000001e-05 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275808+0000", 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5581999999999996e-05 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275818+0000", 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0659000000000001e-05 2024-09-18T10:31:40.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278499+0000", 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026808629999999999 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278574+0000", 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4624999999999998e-05 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.279516+0000", 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094181099999999997 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284510+0000", 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049937749999999998 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285779+0000", 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001269648 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285898+0000", 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118659 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:208 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~376832] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277091+0000", 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.389935464000001, 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093328860000000003, 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 208 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277091+0000", 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277091+0000", 2024-09-18T10:31:40.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277090+0000", 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277443+0000", 2024-09-18T10:31:40.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035313599999999999 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277459+0000", 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6319000000000001e-05 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277465+0000", 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7690000000000002e-06 2024-09-18T10:31:40.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277511+0000", 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6167e-05 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277516+0000", 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8330000000000001e-06 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.280656+0000", 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00314065 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.280728+0000", 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1539999999999996e-05 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.281287+0000", 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00055900600000000002 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286250+0000", 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004963477 2024-09-18T10:31:40.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286354+0000", 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103943 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.286424+0000", 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9676000000000002e-05 2024-09-18T10:31:40.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:209 3.6s0 3:61b75516:::smithi16036501-13:head [setxattr _header (56) in=7b] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277474+0000", 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.389553174, 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163821999999999, 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.686 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 209 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277474+0000", 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277474+0000", 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277473+0000", 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277478+0000", 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2700000000000004e-06 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277483+0000", 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3189999999999996e-06 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277487+0000", 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4109999999999998e-06 2024-09-18T10:31:40.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277536+0000", 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9292999999999997e-05 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277540+0000", 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.036e-06 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283369+0000", 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058282780000000001 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.283496+0000", 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012768400000000001 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284110+0000", 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061387400000000004 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287076+0000", 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029661900000000001 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287154+0000", 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7652999999999997e-05 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287637+0000", 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000483401 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:210 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.389520133000001, 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011901998, 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 210 2024-09-18T10:31:40.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277506+0000", 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277509+0000", 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6199999999999999e-06 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277515+0000", 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.613e-06 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277519+0000", 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.162e-06 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277555+0000", 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6918999999999997e-05 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277558+0000", 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7980000000000001e-06 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284798+0000", 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072393049999999997 2024-09-18T10:31:40.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284870+0000", 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2249999999999994e-05 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287687+0000", 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028174189999999998 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287819+0000", 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013145400000000001 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289409+0000", 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015898380000000001 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:223 3.6s0 3:6108c463:::smithi16036501-6:head [rollback 2] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.321949+0000", 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.345077971999999, 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074965020000000004, 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 223 2024-09-18T10:31:40.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321949+0000", 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321949+0000", 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321948+0000", 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321953+0000", 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8099999999999997e-06 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321958+0000", 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8999999999999997e-06 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321961+0000", 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.208e-06 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.323379+0000", 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001417869 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.323478+0000", 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9118999999999997e-05 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324140+0000", 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00066154099999999997 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.325173+0000", 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010334980000000001 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329393+0000", 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042201369999999997 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329445+0000", 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1759999999999999e-05 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:224 3.6s0 3:6108c463:::smithi16036501-6:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.345038558999999, 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0076431090000000004, 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 224 2024-09-18T10:31:40.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321988+0000", 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321990+0000", 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3719999999999999e-06 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321995+0000", 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.096e-06 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.321998+0000", 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2109999999999998e-06 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324468+0000", 2024-09-18T10:31:40.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024698609999999998 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324534+0000", 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5611999999999995e-05 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.324852+0000", 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000317795 2024-09-18T10:31:40.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.325585+0000", 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00073348200000000004 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329566+0000", 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039810610000000001 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.329631+0000", 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4937999999999994e-05 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:297 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~458752] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:31:40.714 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.345471657999999, 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0124782, 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 297 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321554+0000", 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323224+0000", 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00166989 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323245+0000", 2024-09-18T10:31:40.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1603999999999998e-05 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323251+0000", 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9070000000000004e-06 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323311+0000", 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9367000000000003e-05 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323391+0000", 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0776e-05 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324288+0000", 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089698299999999996 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330155+0000", 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058662219999999999 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333879+0000", 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003724195 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334033+0000", 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015450800000000001 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:298 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.342783059, 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012910115999999999, 2024-09-18T10:31:40.721 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 298 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:31:40.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324242+0000", 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:40.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324759+0000", 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051612499999999998 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324774+0000", 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5777000000000002e-05 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324782+0000", 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.593e-06 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325756+0000", 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097372699999999997 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325903+0000", 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014782799999999999 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326741+0000", 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083760900000000001 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330156+0000", 2024-09-18T10:31:40.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034153109999999999 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337078+0000", 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069219210000000002 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337154+0000", 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5430000000000001e-05 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:299 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~294912] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.340780304999999, 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01141987, 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.728 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 299 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326245+0000", 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326658+0000", 2024-09-18T10:31:40.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041379600000000002 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6379e-05 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326688+0000", 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3531e-05 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327587+0000", 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089865099999999999 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327696+0000", 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010859 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328440+0000", 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074455699999999997 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330157+0000", 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017169279999999999 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337590+0000", 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007433271 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337666+0000", 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5909999999999997e-05 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:300 3.6s0 3:6fd2113e:::smithi16036501-26:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.340327015, 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011253185000000001, 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.735 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 300 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326699+0000", 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326705+0000", 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4219999999999997e-06 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326713+0000", 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2179999999999999e-06 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326721+0000", 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8299999999999996e-06 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329116+0000", 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023944589999999998 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329207+0000", 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1532000000000004e-05 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329752+0000", 2024-09-18T10:31:40.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00054480399999999997 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331260+0000", 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001508258 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337875+0000", 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066149590000000001 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337953+0000", 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7750000000000006e-05 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:301 3.6s0 3:6fd2113e:::smithi16036501-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.340299791, 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015768265, 2024-09-18T10:31:40.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 301 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326726+0000", 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326729+0000", 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3189999999999999e-06 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326739+0000", 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3910000000000004e-06 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326744+0000", 2024-09-18T10:31:40.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7119999999999999e-06 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330251+0000", 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003507175 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330345+0000", 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3974999999999994e-05 2024-09-18T10:31:40.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338416+0000", 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080714459999999995 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338553+0000", 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013656000000000001 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342495+0000", 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003942409 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:307 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.340278221, 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010040014, 2024-09-18T10:31:40.747 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 307 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326748+0000", 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326751+0000", 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1420000000000002e-06 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326757+0000", 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5029999999999997e-06 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326761+0000", 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8449999999999996e-06 2024-09-18T10:31:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330395+0000", 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036348040000000002 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330447+0000", 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2024000000000002e-05 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336788+0000", 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063410860000000001 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:308 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.340261523000001, 2024-09-18T10:31:40.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013544333, 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 308 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326768+0000", 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1820000000000002e-06 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326776+0000", 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5229999999999998e-06 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326781+0000", 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0950000000000003e-06 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330731+0000", 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039508199999999999 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330823+0000", 2024-09-18T10:31:40.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1259000000000002e-05 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340309+0000", 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0094867969999999999 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:309 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.340241103, 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015227746, 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 309 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.758 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326785+0000", 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326789+0000", 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7239999999999998e-06 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326797+0000", 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4100000000000008e-06 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326802+0000", 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.549e-06 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332723+0000", 2024-09-18T10:31:40.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059212609999999997 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332837+0000", 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114342 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342013+0000", 2024-09-18T10:31:40.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091760220000000007 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs1 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.602478+0000", 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.0645486650000002, 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093236050000000004, 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.763 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602478+0000", 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602478+0000", 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602477+0000", 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602530+0000", 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2812000000000002e-05 2024-09-18T10:31:40.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602539+0000", 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7249999999999992e-06 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602546+0000", 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4189999999999999e-06 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602590+0000", 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4706000000000002e-05 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602601+0000", 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0096e-05 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611777+0000", 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091763250000000008 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611802+0000", 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4732999999999999e-05 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs1 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.603697+0000", 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.0633292670000003, 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084361339999999996, 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603697+0000", 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603697+0000", 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603697+0000", 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603714+0000", 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6935e-05 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1446e-05 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603732+0000", 2024-09-18T10:31:40.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5520000000000001e-06 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603778+0000", 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6737000000000003e-05 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603790+0000", 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1136e-05 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612103+0000", 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0083138659999999996 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612134+0000", 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0145e-05 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s5 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728477+0000", 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.93855008100000004, 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081262169999999998, 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728477+0000", 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728477+0000", 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728475+0000", 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729063+0000", 2024-09-18T10:31:40.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058791699999999998 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729076+0000", 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.309e-05 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729085+0000", 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1070000000000005e-06 2024-09-18T10:31:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729141+0000", 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5998000000000002e-05 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729151+0000", 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0828e-05 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736576+0000", 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074242279999999997 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736603+0000", 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7197999999999999e-05 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s5 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.729703+0000", 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.93732334299999998, 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0088806330000000006, 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729703+0000", 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729703+0000", 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729703+0000", 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729815+0000", 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112576 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729826+0000", 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1215e-05 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729832+0000", 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0599999999999996e-06 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729885+0000", 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2298e-05 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729895+0000", 2024-09-18T10:31:40.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0049e-05 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738556+0000", 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086609430000000008 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738584+0000", 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8260999999999999e-05 2024-09-18T10:31:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.7s3 55/33 ECSubWrite(tid=208, reqid=client.4589.0:448, at_version=55'55, trim_to=0'0, roll_forward_to=55'52))", 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.730468+0000", 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.93655885000000005, 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081471909999999998, 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730468+0000", 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730468+0000", 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730467+0000", 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730488+0000", 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1138e-05 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730500+0000", 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1284000000000001e-05 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730506+0000", 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0950000000000001e-06 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.732709+0000", 2024-09-18T10:31:40.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022028009999999999 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.732719+0000", 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0059e-05 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738592+0000", 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058729460000000004 2024-09-18T10:31:40.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738615+0000", 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3516999999999999e-05 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s5 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.93616405000000003, 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077395540000000001, 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730862+0000", 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730884+0000", 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2617999999999999e-05 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730901+0000", 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7031999999999999e-05 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730908+0000", 2024-09-18T10:31:40.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5919999999999997e-06 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.732606+0000", 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016984680000000001 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.732616+0000", 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3360000000000001e-06 2024-09-18T10:31:40.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738589+0000", 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059730030000000002 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738602+0000", 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3376e-05 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:40.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:40.795 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:40.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:40.838 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:40.837+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:40.899 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:40.898+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:40.940 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:40.940 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:40.940 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:40.940 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:40.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:40.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:41.000 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:40.999+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:41.051 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:41.051 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:41.051 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:41.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:41.104 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:41.103+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:41.112 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:41.112 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:41.129 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:41.129 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:41.145 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:41.145 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:41.160 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:41.161 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:302 3.1s0 3:8a576e44:::smithi16036501-20:head [copy-from ver 5] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.836336791000001, 2024-09-18T10:31:41.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020457712999999999, 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 302 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326556+0000", 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326570+0000", 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3662999999999999e-05 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326585+0000", 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5468000000000002e-05 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326593+0000", 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326667+0000", 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4306000000000003e-05 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1179999999999992e-06 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328239+0000", 2024-09-18T10:31:41.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015644680000000001 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328381+0000", 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014198999999999999 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340281+0000", 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011899197 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343588+0000", 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003307197 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346944+0000", 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033560090000000001 2024-09-18T10:31:41.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347016+0000", 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:303 3.1s0 3:8a576e44:::smithi16036501-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:41.173 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.836287533, 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016629574000000001, 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 303 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:41.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326607+0000", 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326611+0000", 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0389999999999998e-06 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326620+0000", 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6039999999999999e-06 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326630+0000", 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326734+0000", 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104131 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1168999999999999e-05 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328659+0000", 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018941400000000001 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5146999999999999e-05 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343012+0000", 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014297432000000001 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343114+0000", 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010218 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343237+0000", 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123347 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:306 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.836182872, 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014939928, 2024-09-18T10:31:41.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 306 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326715+0000", 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7330000000000001e-06 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326724+0000", 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326728+0000", 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0500000000000002e-06 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326892+0000", 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016359100000000001 2024-09-18T10:31:41.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326897+0000", 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5670000000000002e-06 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331380+0000", 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044830549999999997 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331488+0000", 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108174 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341652+0000", 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163635000000001 2024-09-18T10:31:41.184 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:310 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.829823241, 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011394362999999999, 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.185 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 310 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333070+0000", 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334438+0000", 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013686499999999999 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334455+0000", 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6719e-05 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334460+0000", 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2140000000000004e-06 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336102+0000", 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016417669999999999 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336227+0000", 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000124669 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338547+0000", 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023200989999999999 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344211+0000", 2024-09-18T10:31:41.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056638610000000001 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344388+0000", 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017787200000000001 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344466+0000", 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7768999999999994e-05 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:311 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~622592] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.825827213, 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266834, 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 311 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337066+0000", 2024-09-18T10:31:41.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338892+0000", 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268259999999999 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338908+0000", 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5418999999999999e-05 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338972+0000", 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4393000000000005e-05 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341761+0000", 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002788633 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341937+0000", 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017614900000000001 2024-09-18T10:31:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343074+0000", 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001136698 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346619+0000", 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035453020000000002 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350277+0000", 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036582979999999999 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350335+0000", 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.736e-05 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.196 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:312 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~147456] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.823910011000001, 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014117187999999999, 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 312 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338983+0000", 2024-09-18T10:31:41.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339142+0000", 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015861599999999999 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339155+0000", 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2816000000000001e-05 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339164+0000", 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1749999999999994e-06 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344524+0000", 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053596679999999997 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344614+0000", 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0613999999999997e-05 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345181+0000", 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056671599999999999 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346674+0000", 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00149266 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353034+0000", 2024-09-18T10:31:41.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063603460000000002 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353102+0000", 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8188000000000005e-05 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:313 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.823723318999999, 2024-09-18T10:31:41.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014065207, 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 313 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339171+0000", 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339175+0000", 2024-09-18T10:31:41.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5129999999999998e-06 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339186+0000", 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339191+0000", 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1619999999999999e-06 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345694+0000", 2024-09-18T10:31:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065030009999999996 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345792+0000", 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8045000000000001e-05 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346298+0000", 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050656699999999998 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347147+0000", 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084835599999999998 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353189+0000", 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060422569999999997 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353237+0000", 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7890999999999999e-05 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.207 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:314 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.823698379, 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015236665999999999, 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 314 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.208 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339196+0000", 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339199+0000", 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8890000000000002e-06 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339206+0000", 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339214+0000", 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1189999999999999e-06 2024-09-18T10:31:41.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346686+0000", 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074727989999999996 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346756+0000", 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9511000000000006e-05 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353571+0000", 2024-09-18T10:31:41.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068155439999999998 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353677+0000", 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010571 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.354433+0000", 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075619700000000001 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:317 3.1s0 3:8ee00428:::smithi16036501-24:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.403915+0000", 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.758980361000001, 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010837074, 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.214 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 317 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403915+0000", 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403915+0000", 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403914+0000", 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403919+0000", 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2059999999999998e-06 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403926+0000", 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9430000000000003e-06 2024-09-18T10:31:41.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403930+0000", 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.07e-06 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.406258+0000", 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023279049999999999 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.406363+0000", 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010525499999999999 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.406842+0000", 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047876100000000002 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407375+0000", 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053328900000000005 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.414645+0000", 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072695370000000004 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.414752+0000", 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106838 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:318 3.1s0 3:8ee00428:::smithi16036501-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.758959662000001, 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012368581, 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 318 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403938+0000", 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9960000000000002e-06 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403945+0000", 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2089999999999999e-06 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403948+0000", 2024-09-18T10:31:41.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.712e-06 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407079+0000", 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031311490000000002 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407164+0000", 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5321999999999994e-05 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.415143+0000", 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079786830000000003 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.415238+0000", 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4784999999999995e-05 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.416304+0000", 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001066223 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:370 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~638976] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.5674871369999996, 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015060278, 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.225 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 370 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595405+0000", 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596396+0000", 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099055699999999998 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596414+0000", 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8655999999999999e-05 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596422+0000", 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596466+0000", 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4187000000000002e-05 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596471+0000", 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2310000000000004e-06 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598062+0000", 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015909850000000001 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598126+0000", 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4302999999999997e-05 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598945+0000", 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081903900000000003 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610343+0000", 2024-09-18T10:31:41.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011397243 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610417+0000", 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4027000000000001e-05 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610468+0000", 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1551999999999997e-05 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.231 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:371 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~622592] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.5639302449999999, 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013192463, 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 371 2024-09-18T10:31:41.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.233 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598963+0000", 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599585+0000", 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000621708 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599601+0000", 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512e-05 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599608+0000", 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599960+0000", 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035244900000000001 2024-09-18T10:31:41.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600065+0000", 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010497600000000001 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600996+0000", 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00093031500000000003 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612013+0000", 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011017020000000001 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612082+0000", 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8853e-05 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612157+0000", 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5618999999999995e-05 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:372 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~147456] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.5632625650000005, 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012685169, 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.238 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 372 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:31:41.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599631+0000", 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599752+0000", 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121066 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599766+0000", 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3681e-05 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599774+0000", 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7810000000000005e-06 2024-09-18T10:31:41.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601741+0000", 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019676609999999999 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601868+0000", 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012701100000000001 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602485+0000", 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061702700000000003 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612162+0000", 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096771410000000002 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612277+0000", 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114471 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612318+0000", 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0738000000000002e-05 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:373 3.bs0 3:d059b4f5:::smithi16036501-10:head [setxattr _header (56) in=7b] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.5631148719999999, 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012671714000000001, 2024-09-18T10:31:41.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 373 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599783+0000", 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8829999999999999e-06 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599791+0000", 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0169999999999996e-06 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599795+0000", 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7079999999999999e-06 2024-09-18T10:31:41.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603165+0000", 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033702279999999999 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603279+0000", 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113522 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603726+0000", 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044729299999999997 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084374069999999992 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612407+0000", 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024380300000000001 2024-09-18T10:31:41.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612452+0000", 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4453000000000003e-05 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:374 3.bs0 3:d059b4f5:::smithi16036501-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 6.5630957240000001, 2024-09-18T10:31:41.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014050109, 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 374 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599802+0000", 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9550000000000001e-06 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599808+0000", 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9689999999999999e-06 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599811+0000", 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6370000000000001e-06 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603965+0000", 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041538549999999997 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.604070+0000", 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104654 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612750+0000", 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086806729999999999 2024-09-18T10:31:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612839+0000", 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8678999999999996e-05 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.613849+0000", 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010102519999999999 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.255 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:447 3.7s0 3:e76b4e45:::smithi16036501-14:head [append 0~0] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727299+0000", 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4355956320000001, 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010969051, 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 447 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727299+0000", 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727299+0000", 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727299+0000", 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727302+0000", 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.678e-06 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727308+0000", 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0639999999999999e-06 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727311+0000", 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7479999999999999e-06 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728495+0000", 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001183859 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728581+0000", 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6167000000000004e-05 2024-09-18T10:31:41.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729427+0000", 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084514099999999999 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733684+0000", 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042576530000000001 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738195+0000", 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045105910000000004 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738268+0000", 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3700000000000002e-05 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.261 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:448 3.7s0 3:e76b4e45:::smithi16036501-14:head [rollback 6] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4355791359999999, 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011821109999999999, 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 448 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727318+0000", 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1519999999999999e-06 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727323+0000", 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4070000000000001e-06 2024-09-18T10:31:41.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727326+0000", 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.309e-06 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729869+0000", 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002542472 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729965+0000", 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6366000000000005e-05 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730484+0000", 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051885199999999999 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738286+0000", 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007801896 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739074+0000", 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000788429 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739137+0000", 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2623e-05 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:449 3.7s0 3:e76b4e45:::smithi16036501-14:head [append 0~0] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.4355647359999999, 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013587101000000001, 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 449 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:41.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727334+0000", 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727340+0000", 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6790000000000002e-06 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727349+0000", 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5289999999999997e-06 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737235+0000", 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098852860000000001 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737349+0000", 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114485 2024-09-18T10:31:41.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737818+0000", 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046887099999999999 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739481+0000", 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016627129999999999 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740836+0000", 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013552600000000001 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740917+0000", 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1295e-05 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.273 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:459 3.bs0 3:dd16ab4b:::smithi16036501-39:head [rollback 6] snapc 13=[d,6] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.640397+0000", 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.52249790299999999, 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010433824, 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 459 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640397+0000", 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640397+0000", 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640397+0000", 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640399+0000", 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7609999999999999e-06 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640406+0000", 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1340000000000001e-06 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640409+0000", 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8580000000000002e-06 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.641510+0000", 2024-09-18T10:31:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011009920000000001 2024-09-18T10:31:41.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.641601+0000", 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0594999999999996e-05 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.642158+0000", 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00055656800000000001 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650516+0000", 2024-09-18T10:31:41.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0083585740000000006 2024-09-18T10:31:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650753+0000", 2024-09-18T10:31:41.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023697799999999999 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650831+0000", 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7832999999999998e-05 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.284 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:460 3.bs0 3:dd16ab4b:::smithi16036501-39:head [append 0~0] snapc 13=[d,6] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.640414+0000", 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.52248121800000003, 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010624087000000001, 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:41.285 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 460 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640414+0000", 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:41.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640414+0000", 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640413+0000", 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640416+0000", 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1660000000000001e-06 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640421+0000", 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7169999999999996e-06 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.640425+0000", 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7529999999999999e-06 2024-09-18T10:31:41.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002213947 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:41.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.642733+0000", 2024-09-18T10:31:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4099999999999997e-05 2024-09-18T10:31:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643178+0000", 2024-09-18T10:31:41.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044511799999999999 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650519+0000", 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073407869999999997 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650964+0000", 2024-09-18T10:31:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044470700000000002 2024-09-18T10:31:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:41.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651038+0000", 2024-09-18T10:31:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4187e-05 2024-09-18T10:31:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:41.294 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:41.294 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:41.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:41.297 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:41.298 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:41.298 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:41.299 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:41.299 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:41.300 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:41.300 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:41.301 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:41.301 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:41.302 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:41.302 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:41.303 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:41.304 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:41.294+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:41.304 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:41.305 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:41.306 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:41.306 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:41.307 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:41.322 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:41.322 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:41.342 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:41.342 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:41.358 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:41.358 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:41.396 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:41.395+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:41.413 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:41.413 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:41.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:41.497 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:41.496+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:41.523 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:41.523 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:41.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:41.615 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:41.614+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:41.638 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.10 to 1 (10000) 2024-09-18T10:31:41.639 INFO:tasks.rados.rados.0.smithi160.stdout:173: done (2 left) 2024-09-18T10:31:41.639 INFO:tasks.rados.rados.0.smithi160.stdout:174: done (1 left) 2024-09-18T10:31:41.639 INFO:tasks.rados.rados.0.smithi160.stdout:177: done (0 left) 2024-09-18T10:31:41.639 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 38 current snap is 12 2024-09-18T10:31:41.639 INFO:tasks.rados.rados.0.smithi160.stdout:178: seq_num 94 ranges {4472832=425984,4898816=786432,5685248=376832} 2024-09-18T10:31:41.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-18T10:31:41.665 INFO:tasks.rados.rados.0.smithi160.stdout:178: writing smithi16036501-38 from 4472832 to 4898816 tid 1 2024-09-18T10:31:41.669 INFO:tasks.rados.rados.0.smithi160.stdout:178: writing smithi16036501-38 from 4898816 to 5685248 tid 2 2024-09-18T10:31:41.672 INFO:tasks.rados.rados.0.smithi160.stdout:178: writing smithi16036501-38 from 5685248 to 6062080 tid 3 2024-09-18T10:31:41.672 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 32 current snap is 12 2024-09-18T10:31:41.672 INFO:tasks.rados.rados.0.smithi160.stdout:179: seq_num 95 ranges {3145728=442368,3588096=540672,4128768=622592} 2024-09-18T10:31:41.676 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:41.677 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:41.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:41.693 INFO:tasks.rados.rados.0.smithi160.stdout:179: writing smithi16036501-32 from 3145728 to 3588096 tid 1 2024-09-18T10:31:41.694 INFO:tasks.rados.rados.0.smithi160.stdout:179: writing smithi16036501-32 from 3588096 to 4128768 tid 2 2024-09-18T10:31:41.698 INFO:tasks.rados.rados.0.smithi160.stdout:179: writing smithi16036501-32 from 4128768 to 4751360 tid 3 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:180: copy_from oid 44 from oid 21 current snap is 12 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: finishing write tid 1 to smithi16036501-38 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: finishing write tid 2 to smithi16036501-38 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: finishing write tid 3 to smithi16036501-38 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: finishing write tid 4 to smithi16036501-38 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: finishing write tid 5 to smithi16036501-38 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 56 (ObjNum 94 snap 12 seq_num 94) dirty exists 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: left oid 38 (ObjNum 94 snap 12 seq_num 94) 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:178: done (2 left) 2024-09-18T10:31:41.699 INFO:tasks.rados.rados.0.smithi160.stdout:181: delete oid 3 current snap is 12 2024-09-18T10:31:41.703 INFO:tasks.rados.rados.0.smithi160.stdout:179: finishing write tid 1 to smithi16036501-32 2024-09-18T10:31:41.704 INFO:tasks.rados.rados.0.smithi160.stdout:179: finishing write tid 2 to smithi16036501-32 2024-09-18T10:31:41.704 INFO:tasks.rados.rados.0.smithi160.stdout:181: done (2 left) 2024-09-18T10:31:41.704 INFO:tasks.rados.rados.0.smithi160.stdout:182: snap_create 2024-09-18T10:31:41.705 INFO:tasks.rados.rados.0.smithi160.stdout:179: finishing write tid 3 to smithi16036501-32 2024-09-18T10:31:41.706 INFO:tasks.rados.rados.0.smithi160.stdout:179: finishing write tid 4 to smithi16036501-32 2024-09-18T10:31:41.707 INFO:tasks.rados.rados.0.smithi160.stdout:180: finishing copy_from racing read to smithi16036501-44 2024-09-18T10:31:41.708 INFO:tasks.rados.rados.0.smithi160.stdout:179: finishing write tid 5 to smithi16036501-32 2024-09-18T10:31:41.708 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 32 v 42 (ObjNum 95 snap 12 seq_num 95) dirty exists 2024-09-18T10:31:41.708 INFO:tasks.rados.rados.0.smithi160.stdout:179: left oid 32 (ObjNum 95 snap 12 seq_num 95) 2024-09-18T10:31:41.709 INFO:tasks.rados.rados.0.smithi160.stdout:180: finishing copy_from to smithi16036501-44 2024-09-18T10:31:41.709 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 44 v 15 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-18T10:31:41.727 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:41.726+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:41.800 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:41.799+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:41.833 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:41.833 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:41.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:41.902 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:41.901+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:41.943 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:41.944 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:41.952 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:42.002 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:42.002+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:42.093 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.093 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:42.103 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:42.102+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:42.204 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:42.202+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:42.210 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.210 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:42.305 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:42.304+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:42.315 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.315 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:42.406 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:42.405+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:42.420 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.420 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:42.507 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:42.507+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:42.567 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.567 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:42.589 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.11 to 1 (10000) 2024-09-18T10:31:42.590 INFO:tasks.rados.rados.0.smithi160.stdout:179: done (2 left) 2024-09-18T10:31:42.590 INFO:tasks.rados.rados.0.smithi160.stdout:180: done (1 left) 2024-09-18T10:31:42.590 INFO:tasks.rados.rados.0.smithi160.stdout:182: done (0 left) 2024-09-18T10:31:42.590 INFO:tasks.rados.rados.0.smithi160.stdout:183: snap_remove snap 11 2024-09-18T10:31:42.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-18T10:31:42.608 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:42.607+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:42.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T10:31:42.674 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.674 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:42.709 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:42.708+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:42.782 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.783 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:42.810 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:42.809+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.889 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:42.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:42.911 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:42.910+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:42.995 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:42.995 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:43.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:43.011 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:43.010+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:43.101 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:43.101 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:43.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:43.112 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:43.111+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:43.207 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:43.208 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:43.213 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:43.212+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:43.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:43.314 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:43.313+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:43.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:43.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:43.414 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:43.413+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:43.420 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:43.421 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:43.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:43.493 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:43.493 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:43.509 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:43.510 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:43.515 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:43.514+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:43.525 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:43.525 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:43.541 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:43.541 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:43.541 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:43.541 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:43.542 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:43.542 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:43.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:43.557 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:43.557 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:43.573 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:43.573 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:43.590 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:43.590 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:43.595 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-18T10:31:43.595 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.12 to 1 (10000) 2024-09-18T10:31:43.596 INFO:tasks.rados.rados.0.smithi160.stdout:183: done (0 left) 2024-09-18T10:31:43.596 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 22 current snap is 13 2024-09-18T10:31:43.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: seq_num 97 ranges {835584=475136,1310720=442368,1753088=442368,2195456=278528} 2024-09-18T10:31:43.604 INFO:tasks.rados.rados.0.smithi160.stdout:184: writing smithi16036501-22 from 835584 to 1310720 tid 1 2024-09-18T10:31:43.606 INFO:tasks.rados.rados.0.smithi160.stdout:184: writing smithi16036501-22 from 1310720 to 1753088 tid 2 2024-09-18T10:31:43.609 INFO:tasks.rados.rados.0.smithi160.stdout:184: writing smithi16036501-22 from 1753088 to 2195456 tid 3 2024-09-18T10:31:43.611 INFO:tasks.rados.rados.0.smithi160.stdout:184: writing smithi16036501-22 from 2195456 to 2473984 tid 4 2024-09-18T10:31:43.611 INFO:tasks.rados.rados.0.smithi160.stdout:185: rmattr oid 46 current snap is 13 2024-09-18T10:31:43.611 INFO:tasks.rados.rados.0.smithi160.stdout:185: done (1 left) 2024-09-18T10:31:43.611 INFO:tasks.rados.rados.0.smithi160.stdout:186: snap_remove snap 7 2024-09-18T10:31:43.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-18T10:31:43.616 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:43.615+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:43.656 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:43.656 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:43.657 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:43.657 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:43.657 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:43.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:43.718 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:43.717+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 19.484228928, 2024-09-18T10:31:43.766 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038939790000000001, 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.279712+0000", 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280263+0000", 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00055099599999999999 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280278+0000", 2024-09-18T10:31:43.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5228999999999999e-05 2024-09-18T10:31:43.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.769 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.769 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280288+0000", 2024-09-18T10:31:43.769 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5100000000000004e-06 2024-09-18T10:31:43.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280395+0000", 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000107521 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.280408+0000", 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2123999999999999e-05 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.770 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.283584+0000", 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003176089 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:24.283606+0000", 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2775000000000001e-05 2024-09-18T10:31:43.771 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 40/33 ECSubWrite(tid=38, reqid=osd.0.0:38, at_version=40'27, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:25.293708+0000", 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 18.470233757999999, 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00441816, 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.772 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293708+0000", 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293708+0000", 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293707+0000", 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293728+0000", 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0373e-05 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.774 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293740+0000", 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2509e-05 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293747+0000", 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2199999999999997e-06 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293800+0000", 2024-09-18T10:31:43.775 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3677999999999997e-05 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293809+0000", 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298101+0000", 2024-09-18T10:31:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004291726 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298126+0000", 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4720999999999999e-05 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=44'37, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.312841+0000", 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.451100265999999, 2024-09-18T10:31:43.777 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004167034, 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312841+0000", 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312841+0000", 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.778 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.779 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312841+0000", 2024-09-18T10:31:43.779 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:43.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.779 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.779 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.779 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312868+0000", 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7186e-05 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312878+0000", 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.9969999999999993e-06 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312884+0000", 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.28e-06 2024-09-18T10:31:43.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312965+0000", 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0549000000000004e-05 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312974+0000", 2024-09-18T10:31:43.781 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4099999999999997e-06 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.316973+0000", 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039991769999999996 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317008+0000", 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4999000000000002e-05 2024-09-18T10:31:43.782 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.45045163, 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064675760000000001, 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313489+0000", 2024-09-18T10:31:43.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313515+0000", 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6261000000000001e-05 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313533+0000", 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7538e-05 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.785 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313542+0000", 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4509999999999998e-06 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313600+0000", 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7883999999999997e-05 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313610+0000", 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7319999999999993e-06 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319944+0000", 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063339829999999996 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319957+0000", 2024-09-18T10:31:43.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 44/33 ECSubWrite(tid=28, reqid=osd.3.0:28, at_version=44'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314923+0000", 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.449018449, 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050089790000000002, 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.788 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314923+0000", 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314923+0000", 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314922+0000", 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314952+0000", 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9675e-05 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314983+0000", 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0766999999999999e-05 2024-09-18T10:31:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314990+0000", 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1609999999999997e-06 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315075+0000", 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5302000000000004e-05 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315086+0000", 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0628999999999999e-05 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319898+0000", 2024-09-18T10:31:43.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004811727 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319932+0000", 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4223000000000001e-05 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 44/33 ECSubWrite(tid=29, reqid=osd.3.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.321333+0000", 2024-09-18T10:31:43.793 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.442607918, 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036787909999999998, 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321333+0000", 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321333+0000", 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321332+0000", 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321345+0000", 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2329e-05 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321357+0000", 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2391999999999999e-05 2024-09-18T10:31:43.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321364+0000", 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5300000000000002e-06 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321406+0000", 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1870999999999999e-05 2024-09-18T10:31:43.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.321412+0000", 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5599999999999999e-06 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.324984+0000", 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0035722509999999998 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325012+0000", 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7919000000000002e-05 2024-09-18T10:31:43.797 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=47, reqid=osd.0.0:46, at_version=0'0, trim_to=0'0, roll_forward_to=44'39))", 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.325962+0000", 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.437979237, 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053078630000000003, 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325962+0000", 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325962+0000", 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325961+0000", 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325973+0000", 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2e-05 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325989+0000", 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.524e-05 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325996+0000", 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2169999999999997e-06 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326066+0000", 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9927999999999999e-05 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326079+0000", 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3774000000000001e-05 2024-09-18T10:31:43.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331238+0000", 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.005158139 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331270+0000", 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2407999999999999e-05 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 44/33 ECSubWrite(tid=22, reqid=osd.8.0:21, at_version=0'0, trim_to=0'0, roll_forward_to=44'12))", 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.326358+0000", 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.437583863, 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048685600000000001, 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326358+0000", 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326358+0000", 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326357+0000", 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326380+0000", 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3206000000000001e-05 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326394+0000", 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3871e-05 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326401+0000", 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1069999999999999e-06 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326447+0000", 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6272e-05 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326456+0000", 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2099999999999999e-06 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331196+0000", 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047391129999999997 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331226+0000", 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0593999999999999e-05 2024-09-18T10:31:43.806 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=48, reqid=osd.0.0:48, at_version=44'41, trim_to=0'0, roll_forward_to=44'39))", 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.327740+0000", 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.436201412000001, 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003545454, 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327740+0000", 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327740+0000", 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327739+0000", 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327759+0000", 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0004e-05 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327770+0000", 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0399e-05 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327776+0000", 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1009999999999997e-06 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327829+0000", 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3245999999999998e-05 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.327838+0000", 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3260000000000002e-06 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331274+0000", 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0034354889999999999 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331285+0000", 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1673e-05 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/33 ECSubWrite(tid=53, reqid=client.4589.0:299, at_version=45'45, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 13.435532043, 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056329550000000003, 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.811 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328408+0000", 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328607+0000", 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00019832300000000001 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328623+0000", 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6240999999999999e-05 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328633+0000", 2024-09-18T10:31:43.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0015e-05 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328719+0000", 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.6198000000000004e-05 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328731+0000", 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2055000000000001e-05 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334030+0000", 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052983739999999998 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334042+0000", 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2646999999999999e-05 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/33 ECSubWrite(tid=54, reqid=client.4589.0:300, at_version=45'46, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.329668+0000", 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 13.434273340000001, 2024-09-18T10:31:43.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043831139999999996, 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329668+0000", 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329668+0000", 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329667+0000", 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329691+0000", 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4159e-05 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329703+0000", 2024-09-18T10:31:43.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1834000000000001e-05 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329712+0000", 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4759999999999998e-06 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329754+0000", 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2522999999999999e-05 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329762+0000", 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7570000000000004e-06 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334045+0000", 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042831620000000001 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334051+0000", 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0449999999999997e-06 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.820 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 49/33 ECSubWrite(tid=29, reqid=client.4589.0:366, at_version=49'20, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.596247+0000", 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.167694387999999, 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0041183469999999996, 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.821 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596247+0000", 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596247+0000", 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596247+0000", 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:43.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596278+0000", 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1331999999999997e-05 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596292+0000", 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4187e-05 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596300+0000", 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.5909999999999998e-06 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596381+0000", 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0959999999999997e-05 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596487+0000", 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000106507 2024-09-18T10:31:43.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.600337+0000", 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038497309999999999 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.600365+0000", 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8238999999999998e-05 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.825 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 49/33 ECSubWrite(tid=30, reqid=osd.8.0:30, at_version=49'22, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.597124+0000", 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.166817098999999, 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044972470000000002, 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597124+0000", 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597124+0000", 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597123+0000", 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597150+0000", 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.707e-05 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597170+0000", 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9548e-05 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597177+0000", 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4529999999999996e-06 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597252+0000", 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4309999999999998e-05 2024-09-18T10:31:43.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597264+0000", 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2369e-05 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601605+0000", 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043415499999999996 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601622+0000", 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6107999999999999e-05 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.597298+0000", 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.166643021000001, 2024-09-18T10:31:43.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042914049999999999, 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597298+0000", 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597298+0000", 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597298+0000", 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597322+0000", 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3430000000000001e-05 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597335+0000", 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3645999999999999e-05 2024-09-18T10:31:43.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597342+0000", 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7819999999999996e-06 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597395+0000", 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3334999999999997e-05 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597478+0000", 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.276e-05 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601561+0000", 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0040832400000000001 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601590+0000", 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8432000000000002e-05 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.834 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s6 49/33 ECSubWrite(tid=168, reqid=osd.4.0:168, at_version=49'32, trim_to=0'0, roll_forward_to=47'29))", 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.598604+0000", 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.165337269, 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037385919999999998, 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598604+0000", 2024-09-18T10:31:43.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598604+0000", 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598604+0000", 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598628+0000", 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4434999999999999e-05 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598637+0000", 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9050000000000003e-06 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598645+0000", 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4719999999999998e-06 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598710+0000", 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5128000000000004e-05 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.598723+0000", 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.293e-05 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602312+0000", 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0035889770000000001 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602343+0000", 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1093999999999997e-05 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 49/33 ECSubWrite(tid=93, reqid=client.4589.0:361, at_version=49'35, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.602593+0000", 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.161348867999999, 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042164910000000002, 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602593+0000", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602593+0000", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602591+0000", 2024-09-18T10:31:43.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602733+0000", 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000141495 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602750+0000", 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7683999999999999e-05 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602759+0000", 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.6039999999999993e-06 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602814+0000", 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4834999999999999e-05 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.602825+0000", 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0866999999999999e-05 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.606782+0000", 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039567209999999998 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.606809+0000", 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7511000000000001e-05 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.843 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 54/33 ECSubWrite(tid=50, reqid=client.4589.0:413, at_version=54'38, trim_to=0'0, roll_forward_to=53'36))", 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:38.631500+0000", 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 5.1324412700000002, 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003562427, 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631500+0000", 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631500+0000", 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631500+0000", 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631708+0000", 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00020768699999999999 2024-09-18T10:31:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631719+0000", 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0937999999999999e-05 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631725+0000", 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3740000000000003e-06 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631785+0000", 2024-09-18T10:31:43.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0248999999999999e-05 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.631795+0000", 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7149999999999993e-06 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.635041+0000", 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0032464690000000001 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:38.635063+0000", 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.122e-05 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 55/33 ECSubWrite(tid=55, reqid=osd.3.0:55, at_version=55'44, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.656680+0000", 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 4.1072616450000003, 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044938809999999999, 2024-09-18T10:31:43.848 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656680+0000", 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656680+0000", 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656679+0000", 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656710+0000", 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1544000000000002e-05 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656730+0000", 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9364e-05 2024-09-18T10:31:43.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656738+0000", 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7260000000000002e-06 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656781+0000", 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3291000000000003e-05 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656790+0000", 2024-09-18T10:31:43.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5019999999999998e-06 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.661148+0000", 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043573559999999997 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.661174+0000", 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5993999999999999e-05 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 55/33 ECSubWrite(tid=56, reqid=client.4589.0:423, at_version=55'45, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.658008+0000", 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 4.1059333870000003, 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0035607099999999999, 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658008+0000", 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658008+0000", 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658007+0000", 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658273+0000", 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00026534699999999998 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658293+0000", 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0106e-05 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658300+0000", 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8199999999999999e-06 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658360+0000", 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0064e-05 2024-09-18T10:31:43.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.658368+0000", 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.524e-06 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.661549+0000", 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0031809260000000002 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.661569+0000", 2024-09-18T10:31:43.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9675999999999999e-05 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 56/33 ECSubWrite(tid=62, reqid=osd.3.0:62, at_version=56'51, trim_to=0'0, roll_forward_to=55'47))", 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:40.635394+0000", 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 3.1285474290000002, 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045475189999999999, 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635394+0000", 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635394+0000", 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635393+0000", 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635421+0000", 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7611999999999999e-05 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635434+0000", 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3579e-05 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635441+0000", 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1659999999999997e-06 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635609+0000", 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00016783999999999999 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635622+0000", 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2480000000000001e-05 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.639909+0000", 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042873390000000003 2024-09-18T10:31:43.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.639942+0000", 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2592000000000002e-05 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:43.861 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:43.862 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:43.863 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:43.861+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:43.863 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:43.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:43.865 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:43.865 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:43.868 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:43.868 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:43.883 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:43.883 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:43.899 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:43.899 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:43.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:43.898+0000 7f3488d38640 0 -- 172.21.15.63:0/3489347554 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7f34841924b0 msgr2=0x7f3484192910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:43.962 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:43.962 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:43.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:43.963 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:43.963 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:43.962+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:43.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:44.064 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:44.063+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:44.067 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.067 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:44.067 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:44.067 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:44.067 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.075 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:44.115 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:44.115 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:44.131 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:44.131 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:44.165 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:44.164+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:44.175 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 42.112757373000001, 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76442072000000005, 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.176 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060653+0000", 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060661+0000", 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4030000000000007e-06 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.178 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060672+0000", 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060691+0000", 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8553e-05 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060740+0000", 2024-09-18T10:31:44.179 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060747+0000", 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1399999999999997e-06 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.823811+0000", 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76306395100000002 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.180 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824007+0000", 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000196737 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824158+0000", 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000150913 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824701+0000", 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054279800000000004 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.181 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825007+0000", 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030596600000000002 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825044+0000", 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6853000000000001e-05 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825075+0000", 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1102000000000001e-05 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.182 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.177965487000002, 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089361909999999996, 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 47 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.183 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.184 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995550+0000", 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000104314 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995559+0000", 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7069999999999998e-06 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.185 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995568+0000", 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1479999999999995e-06 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999298+0000", 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037306729999999999 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999379+0000", 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0304999999999998e-05 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.186 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999486+0000", 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010773299999999999 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001630+0000", 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021436200000000002 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004321+0000", 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0026907049999999998 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.187 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004355+0000", 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4591000000000001e-05 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004382+0000", 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6869999999999999e-05 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.177835332000001, 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089031370000000002, 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 48 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.189 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.190 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995580+0000", 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.532e-06 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995586+0000", 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8989999999999998e-06 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995590+0000", 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9099999999999998e-06 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999825+0000", 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042355350000000003 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999877+0000", 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1273999999999997e-05 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999957+0000", 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0098000000000005e-05 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001636+0000", 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016796300000000001 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004425+0000", 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0027888000000000001 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.193 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004456+0000", 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0681e-05 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004479+0000", 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3405999999999999e-05 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.194 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.177816225999997, 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089699740000000003, 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 49 2024-09-18T10:31:44.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.196 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995598+0000", 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.495e-06 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995604+0000", 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4160000000000003e-06 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.197 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995607+0000", 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.439e-06 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000235+0000", 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046279570000000003 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000284+0000", 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8316000000000003e-05 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.198 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000364+0000", 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0117999999999994e-05 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002075+0000", 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001711064 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.199 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004511+0000", 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024360699999999998 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004542+0000", 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0998999999999999e-05 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004565+0000", 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3458000000000001e-05 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.200 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.177798975000002, 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011464667, 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 50 2024-09-18T10:31:44.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.202 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995612+0000", 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995711+0000", 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8493999999999996e-05 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995719+0000", 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4160000000000004e-06 2024-09-18T10:31:44.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995724+0000", 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000646+0000", 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049220560000000002 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000740+0000", 2024-09-18T10:31:44.204 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4660999999999994e-05 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000883+0000", 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00014210199999999999 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002077+0000", 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011947150000000001 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007015+0000", 2024-09-18T10:31:44.205 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049376560000000003 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007053+0000", 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8469e-05 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007077+0000", 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3876999999999999e-05 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.177680545000001, 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011450287999999999, 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 51 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.207 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995730+0000", 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995735+0000", 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.938e-06 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995741+0000", 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.209 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995744+0000", 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2729999999999998e-06 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001284+0000", 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00553982 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001354+0000", 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9439999999999999e-05 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.210 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001433+0000", 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9839000000000006e-05 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002242+0000", 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080809000000000002 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007122+0000", 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004880428 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007150+0000", 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8309999999999998e-05 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007181+0000", 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1059000000000002e-05 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.177662144000003, 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011502327, 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 52 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.214 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995754+0000", 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1610000000000002e-06 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995760+0000", 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:31:44.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995764+0000", 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6739999999999999e-06 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001659+0000", 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058952459999999998 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001742+0000", 2024-09-18T10:31:44.216 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2378000000000003e-05 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001835+0000", 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3710999999999998e-05 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002405+0000", 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056997199999999997 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.217 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007206+0000", 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048005959999999999 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007231+0000", 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5449999999999999e-05 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007252+0000", 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0319e-05 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.043552634000001, 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010184168, 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 71 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.219 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.220 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129861+0000", 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1019999999999999e-06 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129864+0000", 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.898e-06 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129866+0000", 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0339999999999999e-06 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133579+0000", 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037133029999999998 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133627+0000", 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7700000000000001e-05 2024-09-18T10:31:44.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133711+0000", 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3752999999999996e-05 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136265+0000", 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025542759999999999 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.139993+0000", 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003728543 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140023+0000", 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0103999999999998e-05 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140043+0000", 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.043543258, 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286735, 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 72 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129937+0000", 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8833999999999999e-05 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.227 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129943+0000", 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6710000000000004e-06 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129946+0000", 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2480000000000001e-06 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133930+0000", 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039838319999999997 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133979+0000", 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9802999999999997e-05 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134057+0000", 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7226999999999998e-05 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136267+0000", 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022104440000000002 2024-09-18T10:31:44.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140087+0000", 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038197069999999999 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140117+0000", 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0156000000000001e-05 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140155+0000", 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8019000000000003e-05 2024-09-18T10:31:44.230 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.043461551999997, 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286248, 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 73 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129952+0000", 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7420000000000002e-06 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.233 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129956+0000", 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0289999999999999e-06 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129959+0000", 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134509+0000", 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045500389999999996 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134554+0000", 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4984999999999997e-05 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134633+0000", 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8549999999999998e-05 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136269+0000", 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016365489999999999 2024-09-18T10:31:44.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140192+0000", 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039229299999999998 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140217+0000", 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4992000000000001e-05 2024-09-18T10:31:44.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140236+0000", 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.895e-05 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.043426717999999, 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010335796, 2024-09-18T10:31:44.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 74 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129984+0000", 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129989+0000", 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5680000000000001e-06 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129995+0000", 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3350000000000003e-06 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129999+0000", 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9500000000000003e-06 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134856+0000", 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048568020000000003 2024-09-18T10:31:44.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134907+0000", 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1450999999999999e-05 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134984+0000", 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6379999999999997e-05 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.241 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136272+0000", 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012878449999999999 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140264+0000", 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039928409999999996 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140289+0000", 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4652999999999999e-05 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.242 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140321+0000", 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1550000000000001e-05 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.043398318000001, 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.01270772, 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.243 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 75 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130094+0000", 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1198000000000004e-05 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130104+0000", 2024-09-18T10:31:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5789999999999993e-06 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130114+0000", 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0808000000000001e-05 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135231+0000", 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051164119999999999 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135281+0000", 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0305e-05 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135363+0000", 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2083999999999995e-05 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136275+0000", 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091162199999999995 2024-09-18T10:31:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142660+0000", 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063848919999999997 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142698+0000", 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8804999999999999e-05 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142721+0000", 2024-09-18T10:31:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2498e-05 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.043289520999998, 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.015446817, 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 76 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130121+0000", 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130128+0000", 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.161e-06 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130135+0000", 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8189999999999992e-06 2024-09-18T10:31:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130139+0000", 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7340000000000002e-06 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135853+0000", 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057137840000000004 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135902+0000", 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9461e-05 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135979+0000", 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6268999999999998e-05 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136467+0000", 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048846600000000001 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145517+0000", 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0090497459999999991 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145546+0000", 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9295999999999999e-05 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145569+0000", 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2697e-05 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:96 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.907540296000001, 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083996039999999998, 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 96 2024-09-18T10:31:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265918+0000", 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7209999999999997e-05 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265925+0000", 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9569999999999996e-06 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265928+0000", 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5429999999999998e-06 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268734+0000", 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028057780000000001 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268778+0000", 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3547000000000002e-05 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268845+0000", 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7162999999999994e-05 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.271236+0000", 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023913910000000001 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274205+0000", 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0029687939999999999 2024-09-18T10:31:44.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274241+0000", 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6041000000000003e-05 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274271+0000", 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9798000000000002e-05 2024-09-18T10:31:44.261 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.907283055000001, 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083081249999999995, 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.263 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 99 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266128+0000", 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266201+0000", 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2515999999999995e-05 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266205+0000", 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8130000000000003e-06 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266209+0000", 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5389999999999999e-06 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270099+0000", 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038896099999999999 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270142+0000", 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3142999999999997e-05 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270209+0000", 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.737e-05 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.267 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.272000+0000", 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001790795 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274386+0000", 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023865639999999999 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274407+0000", 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0856000000000002e-05 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.268 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274437+0000", 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9298999999999998e-05 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.778969431, 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091240130000000003, 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.269 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 121 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:44.270 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394445+0000", 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.292e-06 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394448+0000", 2024-09-18T10:31:44.271 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0819999999999999e-06 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394450+0000", 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9420000000000002e-06 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399432+0000", 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049813349999999999 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.272 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399474+0000", 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2061000000000003e-05 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399540+0000", 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6324999999999999e-05 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403485+0000", 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039450300000000004 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.273 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403519+0000", 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3794000000000002e-05 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403547+0000", 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8195999999999999e-05 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403566+0000", 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9236999999999999e-05 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.274 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.778958942000003, 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0092440720000000007, 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 122 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.275 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394452+0000", 2024-09-18T10:31:44.276 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394455+0000", 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.728e-06 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394460+0000", 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1089999999999997e-06 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394463+0000", 2024-09-18T10:31:44.277 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0939999999999999e-06 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399744+0000", 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052808059999999999 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399814+0000", 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9710999999999997e-05 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.278 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399928+0000", 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000113885 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403609+0000", 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036813979999999998 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403616+0000", 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7390000000000002e-06 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403658+0000", 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2373000000000002e-05 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403697+0000", 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8435e-05 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.280 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.778936651000002, 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011099146000000001, 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 123 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.281 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.282 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394505+0000", 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0673999999999998e-05 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394511+0000", 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5539999999999997e-06 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394513+0000", 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.52e-06 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.283 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400185+0000", 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056715170000000001 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400227+0000", 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2512999999999998e-05 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400322+0000", 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4887000000000001e-05 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403719+0000", 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033967540000000001 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405497+0000", 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001778204 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405542+0000", 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4502000000000002e-05 2024-09-18T10:31:44.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405574+0000", 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.778894495000003, 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.016509943999999999, 2024-09-18T10:31:44.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 124 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.287 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394519+0000", 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.508e-06 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.288 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394522+0000", 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.83e-06 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394524+0000", 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.804e-06 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403059+0000", 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085345979999999991 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.289 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403129+0000", 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0043999999999995e-05 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403245+0000", 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000116123 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.404743+0000", 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001498309 2024-09-18T10:31:44.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410948+0000", 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062045370000000004 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410993+0000", 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5629e-05 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.411027+0000", 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3827e-05 2024-09-18T10:31:44.291 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.es2 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.859085596, 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083182759999999994, 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.292 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.293 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314351+0000", 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4774999999999999e-05 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314361+0000", 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0353999999999999e-05 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314368+0000", 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.601e-06 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.294 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314441+0000", 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3112000000000001e-05 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314450+0000", 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2220000000000008e-06 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322612+0000", 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081619929999999993 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.295 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322644+0000", 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2419999999999998e-05 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.296 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.297 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.297 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.298 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:44.299 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:44.297+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:44.396 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.397 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:44.397 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:44.397 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.398 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:44.397+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:44.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:44.499 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:44.498+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:44.500 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.501 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:44.501 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:44.501 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:44.501 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.13 to 1 (10000) 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:186: done (1 left) 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:187: rollback oid 19 current snap is 13 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 19 to 12 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: finishing write tid 1 to smithi16036501-22 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: finishing write tid 2 to smithi16036501-22 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: finishing write tid 3 to smithi16036501-22 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: finishing write tid 4 to smithi16036501-22 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: finishing write tid 5 to smithi16036501-22 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:184: finishing write tid 6 to smithi16036501-22 2024-09-18T10:31:44.596 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 22 v 70 (ObjNum 97 snap 13 seq_num 97) dirty exists 2024-09-18T10:31:44.597 INFO:tasks.rados.rados.0.smithi160.stdout:184: left oid 22 (ObjNum 97 snap 13 seq_num 97) 2024-09-18T10:31:44.597 INFO:tasks.rados.rados.0.smithi160.stdout:184: done (1 left) 2024-09-18T10:31:44.597 INFO:tasks.rados.rados.0.smithi160.stdout:188: rollback oid 49 current snap is 13 2024-09-18T10:31:44.597 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 49 to 12 2024-09-18T10:31:44.597 INFO:tasks.rados.rados.0.smithi160.stdout:189: snap_create 2024-09-18T10:31:44.601 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:44.599+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:44.604 INFO:tasks.rados.rados.0.smithi160.stdout:187: finishing rollback tid 0 to smithi16036501-19 2024-09-18T10:31:44.605 INFO:tasks.rados.rados.0.smithi160.stdout:188: finishing rollback tid 0 to smithi16036501-49 2024-09-18T10:31:44.605 INFO:tasks.rados.rados.0.smithi160.stdout:187: finishing rollback tid 1 to smithi16036501-19 2024-09-18T10:31:44.609 INFO:tasks.rados.rados.0.smithi160.stdout:188: finishing rollback tid 1 to smithi16036501-49 2024-09-18T10:31:44.609 INFO:tasks.rados.rados.0.smithi160.stdout:188: finishing rollback tid 2 to smithi16036501-49 2024-09-18T10:31:44.609 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 49 v 36 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-18T10:31:44.610 INFO:tasks.rados.rados.0.smithi160.stdout:187: finishing rollback tid 2 to smithi16036501-19 2024-09-18T10:31:44.611 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 41 (ObjNum 92 snap 11 seq_num 92) dirty exists 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.299903413999999, 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054360959999999996, 2024-09-18T10:31:44.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.618 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314517+0000", 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314545+0000", 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7441e-05 2024-09-18T10:31:44.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314558+0000", 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2716e-05 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314564+0000", 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7190000000000004e-06 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314614+0000", 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9595000000000002e-05 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314623+0000", 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9889999999999998e-06 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319931+0000", 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053084439999999998 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.621 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319954+0000", 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3073000000000001e-05 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.2s5 44/33 ECSubWrite(tid=11, reqid=osd.14.0:11, at_version=44'10, trim_to=0'0, roll_forward_to=42'8))", 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314913+0000", 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.299508455, 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050190039999999997, 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.622 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314913+0000", 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314913+0000", 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314913+0000", 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:44.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314965+0000", 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1932999999999999e-05 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314979+0000", 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4188999999999999e-05 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314987+0000", 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4499999999999998e-06 2024-09-18T10:31:44.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315054+0000", 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6991999999999998e-05 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315063+0000", 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.815e-06 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319900+0000", 2024-09-18T10:31:44.625 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048360319999999997 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319932+0000", 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2826e-05 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.296926919000001, 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00557647, 2024-09-18T10:31:44.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.627 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317494+0000", 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317507+0000", 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317522+0000", 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.45e-05 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.628 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317529+0000", 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4619999999999999e-06 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317587+0000", 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7552000000000001e-05 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317597+0000", 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8810000000000008e-06 2024-09-18T10:31:44.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323054+0000", 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054572689999999998 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323071+0000", 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7435000000000002e-05 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.630 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 44/33 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=44'28, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.318231+0000", 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.296190507, 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048534099999999998, 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318231+0000", 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318231+0000", 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318230+0000", 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.632 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318260+0000", 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9439999999999999e-05 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318273+0000", 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3183999999999999e-05 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318278+0000", 2024-09-18T10:31:44.633 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5160000000000002e-06 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318325+0000", 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7008000000000001e-05 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318335+0000", 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8779999999999993e-06 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.634 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323074+0000", 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047386559999999999 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323085+0000", 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0679000000000001e-05 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 44/33 ECSubWrite(tid=21, reqid=osd.8.0:21, at_version=44'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:44.635 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.2951535, 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063338889999999997, 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:44.636 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319300+0000", 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1572000000000002e-05 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.637 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319313+0000", 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3832000000000001e-05 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319322+0000", 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1419999999999999e-06 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319384+0000", 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1598000000000002e-05 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319394+0000", 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8079999999999999e-06 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325566+0000", 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006172192 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325602+0000", 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6075999999999998e-05 2024-09-18T10:31:44.639 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 44/33 ECSubWrite(tid=124, reqid=osd.4.0:115, at_version=0'0, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.326403+0000", 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.288019140999999, 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046826669999999997, 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326403+0000", 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326403+0000", 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326402+0000", 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326427+0000", 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4941000000000001e-05 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326442+0000", 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5087e-05 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326449+0000", 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7549999999999994e-06 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.642 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326504+0000", 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4867000000000002e-05 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326518+0000", 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4117000000000001e-05 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331051+0000", 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045326330000000003 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.643 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331085+0000", 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4215999999999999e-05 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=130, reqid=client.4589.0:310, at_version=45'32, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.275499436, 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050500179999999999, 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.644 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339438+0000", 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051584199999999997 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339453+0000", 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5784999999999999e-05 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.646 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339461+0000", 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1349999999999992e-06 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339529+0000", 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7595999999999995e-05 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339542+0000", 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2451e-05 2024-09-18T10:31:44.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343951+0000", 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044095979999999998 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343972+0000", 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1254e-05 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.27358383, 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054953399999999996, 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.649 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340837+0000", 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341640+0000", 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080260699999999999 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341653+0000", 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3579e-05 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341665+0000", 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1549000000000001e-05 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341728+0000", 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2787999999999996e-05 2024-09-18T10:31:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341738+0000", 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0380000000000001e-05 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346306+0000", 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045678009999999998 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.652 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346333+0000", 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7606999999999998e-05 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=132, reqid=client.4589.0:311, at_version=45'33, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.270691742, 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006336899, 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343729+0000", 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344271+0000", 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054216699999999997 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344284+0000", 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2551999999999999e-05 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344290+0000", 2024-09-18T10:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5599999999999999e-06 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344376+0000", 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5834000000000005e-05 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344387+0000", 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0942e-05 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350040+0000", 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056529889999999998 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350067+0000", 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6857999999999999e-05 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.269092605000001, 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0074420069999999996, 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345328+0000", 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345430+0000", 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010200399999999999 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345444+0000", 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3827e-05 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345454+0000", 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5219999999999996e-06 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346383+0000", 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00092949799999999996 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346395+0000", 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1858999999999999e-05 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352753+0000", 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063576789999999998 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352771+0000", 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8556999999999999e-05 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=134, reqid=client.4589.0:313, at_version=45'35, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.267945811000001, 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063042000000000003, 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346475+0000", 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346495+0000", 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9876000000000001e-05 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346507+0000", 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2407e-05 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346514+0000", 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7220000000000002e-06 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346794+0000", 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00028027400000000001 2024-09-18T10:31:44.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346807+0000", 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2388999999999999e-05 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352774+0000", 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059673729999999998 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.666 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352780+0000", 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1279999999999996e-06 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=135, reqid=client.4589.0:302, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.267210563000001, 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055314830000000002, 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347210+0000", 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347224+0000", 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3794e-05 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347239+0000", 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5313000000000001e-05 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347246+0000", 2024-09-18T10:31:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7700000000000004e-06 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347295+0000", 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8534e-05 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347306+0000", 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1224e-05 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352720+0000", 2024-09-18T10:31:44.670 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054135549999999996 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352743+0000", 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3156999999999999e-05 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=141, reqid=client.4589.0:317, at_version=45'27, trim_to=0'0, roll_forward_to=45'25))", 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.406852+0000", 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.207569311, 2024-09-18T10:31:44.671 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048746379999999997, 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406852+0000", 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406852+0000", 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406851+0000", 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406869+0000", 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7557000000000001e-05 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406882+0000", 2024-09-18T10:31:44.673 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.305e-05 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406888+0000", 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2539999999999998e-06 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406945+0000", 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6258000000000002e-05 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.674 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406954+0000", 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.329e-06 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.411671+0000", 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047170249999999997 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.411727+0000", 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6155e-05 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 49/33 ECSubWrite(tid=29, reqid=client.4589.0:366, at_version=49'20, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.596836+0000", 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 11.017585665, 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047539649999999998, 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596836+0000", 2024-09-18T10:31:44.676 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596836+0000", 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596835+0000", 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.677 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596866+0000", 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1013000000000003e-05 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596880+0000", 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3334e-05 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596887+0000", 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0709999999999997e-06 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.678 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.596977+0000", 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9769000000000001e-05 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597007+0000", 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0648999999999997e-05 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601561+0000", 2024-09-18T10:31:44.679 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045542250000000003 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601590+0000", 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8585000000000002e-05 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.013316721000001, 2024-09-18T10:31:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053213160000000004, 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.681 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601104+0000", 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601311+0000", 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000206684 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.682 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601324+0000", 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3562e-05 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601330+0000", 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3630000000000002e-06 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601373+0000", 2024-09-18T10:31:44.683 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3516000000000001e-05 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601380+0000", 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6109999999999999e-06 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606405+0000", 2024-09-18T10:31:44.684 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050246329999999997 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606426+0000", 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1841e-05 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:31:44.685 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.011934220000001, 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064992319999999998, 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.686 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602487+0000", 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602544+0000", 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7605000000000002e-05 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602559+0000", 2024-09-18T10:31:44.687 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4873e-05 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602566+0000", 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0180000000000004e-06 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603204+0000", 2024-09-18T10:31:44.688 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00063799400000000002 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603216+0000", 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1888e-05 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608951+0000", 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057352130000000003 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.689 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608987+0000", 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5417000000000003e-05 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.010696844, 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052845369999999997, 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.690 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603724+0000", 2024-09-18T10:31:44.691 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603740+0000", 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.611e-05 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603753+0000", 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2379e-05 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.692 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603760+0000", 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9920000000000001e-06 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603799+0000", 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9725000000000003e-05 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603806+0000", 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2790000000000004e-06 2024-09-18T10:31:44.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608992+0000", 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051865909999999999 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.609009+0000", 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7323e-05 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.694 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=195, reqid=client.4589.0:427, at_version=55'49, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 4.9455448149999999, 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0073182050000000004, 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.695 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669388+0000", 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051155899999999997 2024-09-18T10:31:44.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669401+0000", 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2711000000000001e-05 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669409+0000", 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6580000000000002e-06 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669465+0000", 2024-09-18T10:31:44.697 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5994e-05 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669472+0000", 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.695e-06 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676164+0000", 2024-09-18T10:31:44.698 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0066911820000000004 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676195+0000", 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1532000000000002e-05 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=196, reqid=client.4589.0:428, at_version=55'50, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 4.9415480120000002, 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057749089999999999, 2024-09-18T10:31:44.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.700 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672873+0000", 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673445+0000", 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00057173499999999997 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673456+0000", 2024-09-18T10:31:44.701 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1579999999999999e-05 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673463+0000", 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7320000000000001e-06 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673504+0000", 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0636999999999997e-05 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673516+0000", 2024-09-18T10:31:44.702 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2187e-05 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678624+0000", 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051085599999999998 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678649+0000", 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4375999999999998e-05 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.703 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=197, reqid=client.4589.0:429, at_version=55'51, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.673768+0000", 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 4.9406533389999998, 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004890564, 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673768+0000", 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673768+0000", 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673768+0000", 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:44.705 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673810+0000", 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1844000000000001e-05 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673821+0000", 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1783999999999999e-05 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673828+0000", 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6359999999999997e-06 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:44.706 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.674052+0000", 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000224174 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.674060+0000", 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.5970000000000003e-06 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678652+0000", 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045917349999999996 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:44.707 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678659+0000", 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.43e-06 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:44.708 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-18T10:31:44.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:44.711 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:44.709+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:44.809 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.809 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:44.809 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:44.809 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.810 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:44.809+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:44.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:44.911 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:44.910+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:44.914 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:44.914 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:44.914 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:44.914 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:44.914 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:44.922 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:45.012 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:45.012+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s2 44/33 ECSubWrite(tid=113, reqid=osd.4.0:111, at_version=0'0, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.706326719, 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0096622919999999994, 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.021 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:31:45.022 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312552+0000", 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1926000000000001e-05 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312564+0000", 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2734e-05 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.023 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312577+0000", 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2539e-05 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312636+0000", 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9327999999999998e-05 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312644+0000", 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0399999999999993e-06 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.024 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322170+0000", 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0095254759999999997 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322203+0000", 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3006000000000002e-05 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.025 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s1 44/33 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=44'37, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.312611+0000", 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.706256488999999, 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0096383990000000006, 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312611+0000", 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.026 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312611+0000", 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312610+0000", 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312634+0000", 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3377999999999999e-05 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.027 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312644+0000", 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0166000000000001e-05 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312651+0000", 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4819999999999997e-06 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001182893 2024-09-18T10:31:45.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313844+0000", 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4760000000000004e-06 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322229+0000", 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083849960000000005 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322249+0000", 2024-09-18T10:31:45.029 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0214e-05 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s1 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.705791487000001, 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.012375268, 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.030 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313075+0000", 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313101+0000", 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5962e-05 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313112+0000", 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1250000000000001e-05 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313119+0000", 2024-09-18T10:31:45.032 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7909999999999999e-06 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314181+0000", 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001061698 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314190+0000", 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.0729999999999994e-06 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.033 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325424+0000", 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011234141 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325451+0000", 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7127e-05 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 44/33 ECSubWrite(tid=114, reqid=osd.4.0:114, at_version=44'28, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.705033326000001, 2024-09-18T10:31:45.034 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0084741179999999992, 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313833+0000", 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313855+0000", 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2441000000000001e-05 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313868+0000", 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3063e-05 2024-09-18T10:31:45.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313876+0000", 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3869999999999997e-06 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313948+0000", 2024-09-18T10:31:45.037 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313958+0000", 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5440000000000004e-06 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322284+0000", 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.008326244 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.038 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322308+0000", 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4128999999999999e-05 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.703949854999999, 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010775300999999999, 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.039 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314987+0000", 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0817999999999999e-05 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315007+0000", 2024-09-18T10:31:45.041 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9281000000000001e-05 2024-09-18T10:31:45.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.042 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.042 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.042 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315014+0000", 2024-09-18T10:31:45.042 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7160000000000003e-06 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315107+0000", 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2695999999999995e-05 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315116+0000", 2024-09-18T10:31:45.043 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7199999999999995e-06 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325662+0000", 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010545769 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325693+0000", 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1049e-05 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.es1 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.315088+0000", 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.703779599000001, 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010384595, 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315088+0000", 2024-09-18T10:31:45.045 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315088+0000", 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315087+0000", 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.046 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315209+0000", 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000121617 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315221+0000", 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1911e-05 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315227+0000", 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6989999999999997e-06 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.047 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315429+0000", 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000202139 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315440+0000", 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0088000000000001e-05 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325455+0000", 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010015856 2024-09-18T10:31:45.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325472+0000", 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6728e-05 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.049 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.317653+0000", 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.701214056, 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0078543569999999993, 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317653+0000", 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.050 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317653+0000", 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317652+0000", 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317665+0000", 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3203e-05 2024-09-18T10:31:45.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317676+0000", 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1208e-05 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317692+0000", 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5367999999999999e-05 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.052 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317735+0000", 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3572999999999998e-05 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317744+0000", 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7770000000000008e-06 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325490+0000", 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0077454200000000003 2024-09-18T10:31:45.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.054 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.054 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.054 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325507+0000", 2024-09-18T10:31:45.054 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7776999999999999e-05 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 44/33 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=44'28, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.318252+0000", 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.700615580000001, 2024-09-18T10:31:45.055 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.012632519, 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318252+0000", 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318252+0000", 2024-09-18T10:31:45.056 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318251+0000", 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318269+0000", 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7972e-05 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.057 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318281+0000", 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2516e-05 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318287+0000", 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3929999999999999e-06 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318339+0000", 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2361999999999998e-05 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.058 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.059 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.059 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318344+0000", 2024-09-18T10:31:45.059 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.417e-06 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.330858+0000", 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.012513188999999999 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.330884+0000", 2024-09-18T10:31:45.060 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.641e-05 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.345487+0000", 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.673380241, 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072124850000000003, 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.061 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345487+0000", 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345487+0000", 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345486+0000", 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345597+0000", 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00011134 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345610+0000", 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2444e-05 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345615+0000", 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0930000000000002e-06 2024-09-18T10:31:45.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345656+0000", 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0751999999999999e-05 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345662+0000", 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.4760000000000003e-06 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352665+0000", 2024-09-18T10:31:45.064 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070024670000000001 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352699+0000", 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4790999999999999e-05 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s2 45/33 ECSubWrite(tid=141, reqid=client.4589.0:317, at_version=45'27, trim_to=0'0, roll_forward_to=45'25))", 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.406878+0000", 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.611989294000001, 2024-09-18T10:31:45.065 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0075315410000000001, 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406878+0000", 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406878+0000", 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406877+0000", 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406900+0000", 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2793e-05 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406914+0000", 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4287999999999999e-05 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406921+0000", 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3270000000000003e-06 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406969+0000", 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7361999999999998e-05 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406978+0000", 2024-09-18T10:31:45.068 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9299999999999992e-06 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.414359+0000", 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0073809269999999998 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.414409+0000", 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0705999999999999e-05 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.069 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 50/33 ECSubWrite(tid=174, reqid=client.4589.0:370, at_version=50'42, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.599149+0000", 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.419718596999999, 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.007276701, 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.599149+0000", 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.599149+0000", 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.599148+0000", 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600317+0000", 2024-09-18T10:31:45.071 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011683399999999999 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600329+0000", 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2302e-05 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600336+0000", 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3900000000000004e-06 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.072 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600411+0000", 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4574999999999997e-05 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600425+0000", 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4514e-05 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606398+0000", 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059725029999999997 2024-09-18T10:31:45.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606425+0000", 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7345999999999999e-05 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.cs6 60/33 ECSubWrite(tid=96, reqid=osd.5.0:96, at_version=60'43, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.603203+0000", 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.41566397199999999, 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0068442030000000001, 2024-09-18T10:31:45.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603203+0000", 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603203+0000", 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.075 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603203+0000", 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603226+0000", 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3308000000000001e-05 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603234+0000", 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9950000000000005e-06 2024-09-18T10:31:45.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603239+0000", 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4669999999999998e-06 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603402+0000", 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00016326099999999999 2024-09-18T10:31:45.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603410+0000", 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.225e-06 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610026+0000", 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0066163259999999996 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610047+0000", 2024-09-18T10:31:45.078 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0927000000000001e-05 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.cs6 60/33 ECSubWrite(tid=97, reqid=osd.5.0:97, at_version=60'45, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.415623152, 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072626629999999999, 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.079 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.080 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603262+0000", 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8258999999999999e-05 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603269+0000", 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8000000000000001e-06 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603273+0000", 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9890000000000003e-06 2024-09-18T10:31:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.605773+0000", 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025003830000000001 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.605779+0000", 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5520000000000004e-06 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610491+0000", 2024-09-18T10:31:45.082 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047124439999999997 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610507+0000", 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5532e-05 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs3 60/33 ECSubWrite(tid=133, reqid=osd.13.0:133, at_version=60'58, trim_to=0'0, roll_forward_to=56'56))", 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.608207+0000", 2024-09-18T10:31:45.083 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.41066029399999998, 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.007044664, 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608207+0000", 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608207+0000", 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608207+0000", 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608227+0000", 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0483e-05 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608235+0000", 2024-09-18T10:31:45.085 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0679999999999997e-06 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608240+0000", 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1019999999999996e-06 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608275+0000", 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4357000000000003e-05 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.086 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608281+0000", 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6429999999999998e-06 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.615229+0000", 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006947295 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.615251+0000", 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2909e-05 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.087 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs3 60/33 ECSubWrite(tid=134, reqid=osd.13.0:134, at_version=60'60, trim_to=0'0, roll_forward_to=56'56))", 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.608918+0000", 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.40994926300000001, 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091234469999999998, 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608918+0000", 2024-09-18T10:31:45.088 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608918+0000", 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608917+0000", 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.089 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608938+0000", 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0448000000000001e-05 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608949+0000", 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1253999999999999e-05 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608955+0000", 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9800000000000003e-06 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.090 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610475+0000", 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0015199460000000001 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610485+0000", 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.9830000000000008e-06 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618006+0000", 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0075214629999999999 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.091 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618041+0000", 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5040999999999999e-05 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/33 ECSubWrite(tid=242, reqid=osd.4.0:239, at_version=0'0, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.611115+0000", 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.40775257599999998, 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072412639999999999, 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611115+0000", 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611115+0000", 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.093 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611114+0000", 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611124+0000", 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.9860000000000006e-06 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611132+0000", 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0469999999999994e-06 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.094 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611137+0000", 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0010000000000001e-06 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611165+0000", 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8081000000000001e-05 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611170+0000", 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0440000000000003e-06 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.095 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618330+0000", 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0071604549999999996 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618356+0000", 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5313e-05 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.096 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/33 ECSubWrite(tid=243, reqid=osd.4.0:243, at_version=60'76, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.612618+0000", 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.40624902600000001, 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081941400000000008, 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612618+0000", 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.097 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.098 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612618+0000", 2024-09-18T10:31:45.098 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.098 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.098 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612617+0000", 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612639+0000", 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1943e-05 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612658+0000", 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8462999999999999e-05 2024-09-18T10:31:45.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612665+0000", 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8820000000000003e-06 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612711+0000", 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6078000000000002e-05 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.100 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612719+0000", 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0790000000000001e-06 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620789+0000", 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0080698490000000005 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620812+0000", 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3549000000000001e-05 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.101 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/33 ECSubWrite(tid=244, reqid=osd.4.0:244, at_version=60'78, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.40518894999999999, 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0098792110000000006, 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.102 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.103 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613701+0000", 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3716000000000001e-05 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613711+0000", 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2979999999999997e-06 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613716+0000", 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.84e-06 2024-09-18T10:31:45.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.615644+0000", 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0019279130000000001 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.615653+0000", 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.8510000000000005e-06 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623528+0000", 2024-09-18T10:31:45.105 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0078746100000000006 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623557+0000", 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9499e-05 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs3 60/33 ECSubWrite(tid=137, reqid=osd.13.0:137, at_version=60'62, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619189+0000", 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.39967762699999998, 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070220860000000003, 2024-09-18T10:31:45.106 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619189+0000", 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619189+0000", 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.107 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619189+0000", 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619202+0000", 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3329999999999999e-05 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619210+0000", 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8269999999999998e-06 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619215+0000", 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9579999999999998e-06 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619255+0000", 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0054e-05 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619265+0000", 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3309999999999993e-06 2024-09-18T10:31:45.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.626188+0000", 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0069232950000000003 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.626212+0000", 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3747000000000002e-05 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.110 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs3 60/33 ECSubWrite(tid=138, reqid=osd.13.0:138, at_version=60'64, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619985+0000", 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 0.39888232499999998, 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0088989340000000007, 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619985+0000", 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:45.111 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619985+0000", 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619984+0000", 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619996+0000", 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1819e-05 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.112 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620003+0000", 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7020000000000004e-06 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620007+0000", 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2409999999999997e-06 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.621085+0000", 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0010775489999999999 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.113 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.621095+0000", 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0723000000000001e-05 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628861+0000", 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.007765297 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628884+0000", 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3042000000000001e-05 2024-09-18T10:31:45.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.115 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:45.115 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:45.115 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:45.116 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:45.117 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:45.115+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:45.217 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:45.215+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:45.228 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:45.228 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:45.228 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:45.228 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:45.237 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:45.318 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:45.316+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:45.375 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:45.375 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:45.375 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:45.375 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:45.375 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:45.385 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:45.429 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:45.428+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:45.485 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:45.485 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:45.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:45.485 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:45.485 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 38/33 ECSubWrite(tid=55, reqid=client.4589.0:200, at_version=38'19, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.279407+0000", 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 22.203610883, 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059160879999999999, 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279407+0000", 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279407+0000", 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279406+0000", 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279911+0000", 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050487299999999998 2024-09-18T10:31:45.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279928+0000", 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.715e-05 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279935+0000", 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1029999999999996e-06 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.488 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279984+0000", 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8946999999999997e-05 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279992+0000", 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2379999999999997e-06 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285295+0000", 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053024350000000003 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.489 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285323+0000", 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8153e-05 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.es5 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.168853189, 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010619747000000001, 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.490 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314194+0000", 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9682000000000001e-05 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314208+0000", 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4456e-05 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.492 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314216+0000", 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4039999999999998e-06 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314276+0000", 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0130000000000002e-05 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314307+0000", 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0667999999999998e-05 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.493 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324753+0000", 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010446057999999999 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324784+0000", 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1608e-05 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.2s1 44/33 ECSubWrite(tid=11, reqid=osd.14.0:11, at_version=44'10, trim_to=0'0, roll_forward_to=42'8))", 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:45.494 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.168138227, 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010009494000000001, 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:45.495 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314896+0000", 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7241e-05 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.496 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314908+0000", 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1807000000000001e-05 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314914+0000", 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6470000000000003e-06 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314993+0000", 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9171999999999993e-05 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.497 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315014+0000", 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1325999999999999e-05 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324876+0000", 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.009861692 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324889+0000", 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2867000000000001e-05 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.498 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=73, reqid=osd.13.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.167383142999999, 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0092378719999999994, 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:45.499 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.500 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315646+0000", 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2227e-05 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315665+0000", 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9485999999999999e-05 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315676+0000", 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1144e-05 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.501 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315894+0000", 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000217343 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.316163+0000", 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00026891000000000003 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324826+0000", 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086628130000000001 2024-09-18T10:31:45.502 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324872+0000", 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6819e-05 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=74, reqid=client.4589.0:278, at_version=44'22, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.163819545999999, 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091122809999999999, 2024-09-18T10:31:45.503 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.504 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319197+0000", 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319499+0000", 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00030185299999999998 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319516+0000", 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7447000000000001e-05 2024-09-18T10:31:45.505 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319524+0000", 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8560000000000007e-06 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319581+0000", 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6787999999999999e-05 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319590+0000", 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2150000000000007e-06 2024-09-18T10:31:45.506 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328264+0000", 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086732709999999998 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328310+0000", 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6757e-05 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s3 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.162089564999999, 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013131472, 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.508 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320927+0000", 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320950+0000", 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2860000000000001e-05 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.509 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320963+0000", 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3281999999999999e-05 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320970+0000", 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.815e-06 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321072+0000", 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000101679 2024-09-18T10:31:45.510 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321082+0000", 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0112000000000001e-05 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334037+0000", 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012954979 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334060+0000", 2024-09-18T10:31:45.511 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2616000000000002e-05 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:285 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~442368] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.159997502, 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013315863000000001, 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.512 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 285 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.513 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323018+0000", 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323786+0000", 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076849899999999996 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323806+0000", 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9749999999999999e-05 2024-09-18T10:31:45.514 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323816+0000", 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.91e-06 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326375+0000", 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025593740000000001 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326486+0000", 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000110361 2024-09-18T10:31:45.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328927+0000", 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024414390000000001 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334196+0000", 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052685989999999997 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336273+0000", 2024-09-18T10:31:45.516 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020772350000000002 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336336+0000", 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2928999999999993e-05 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:286 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~720896] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.154309893000001, 2024-09-18T10:31:45.517 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080273050000000002, 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 286 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.518 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328706+0000", 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329422+0000", 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00071608700000000002 2024-09-18T10:31:45.519 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329439+0000", 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6762e-05 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329444+0000", 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2220000000000001e-06 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.520 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330184+0000", 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074012100000000005 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330295+0000", 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000111335 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331780+0000", 2024-09-18T10:31:45.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001484899 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334386+0000", 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0026057580000000001 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336669+0000", 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002283532 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.522 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336735+0000", 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5593999999999996e-05 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:287 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~49152] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329450+0000", 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.153567556999999, 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0074801700000000004, 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.523 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 287 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329450+0000", 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329450+0000", 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.524 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329449+0000", 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329470+0000", 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0795e-05 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329476+0000", 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2820000000000002e-06 2024-09-18T10:31:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329480+0000", 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.269e-06 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.332958+0000", 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034782060000000002 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.333074+0000", 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000115678 2024-09-18T10:31:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.333586+0000", 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000512862 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336352+0000", 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002766003 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336893+0000", 2024-09-18T10:31:45.527 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00054050699999999997 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336930+0000", 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7327999999999999e-05 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:288 3.0s0 3:02ffc1f8:::smithi16036501-17:head [setxattr _header (56) in=7b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.153534553, 2024-09-18T10:31:45.528 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0084205180000000001, 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 288 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.529 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.530 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329485+0000", 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.813e-06 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329489+0000", 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3639999999999999e-06 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329491+0000", 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1789999999999998e-06 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.531 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334535+0000", 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050437019999999997 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335074+0000", 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00053956900000000005 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335709+0000", 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00063488599999999998 2024-09-18T10:31:45.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337448+0000", 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001738945 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337849+0000", 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040134200000000001 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337904+0000", 2024-09-18T10:31:45.533 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4129000000000003e-05 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:289 3.0s0 3:02ffc1f8:::smithi16036501-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.153524058999999, 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0097207330000000005, 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.534 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 289 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.535 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329493+0000", 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329495+0000", 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.376e-06 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329498+0000", 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6380000000000002e-06 2024-09-18T10:31:45.536 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329501+0000", 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2670000000000001e-06 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337024+0000", 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075235809999999997 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337080+0000", 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5986999999999998e-05 2024-09-18T10:31:45.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338204+0000", 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001123476 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338288+0000", 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4359999999999999e-05 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.538 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.339214+0000", 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000926333 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597200+0000", 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.885818075, 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055646059999999997, 2024-09-18T10:31:45.539 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597200+0000", 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597200+0000", 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.540 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597199+0000", 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597218+0000", 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9412999999999999e-05 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597229+0000", 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1158000000000001e-05 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.541 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597235+0000", 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0329999999999997e-06 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597335+0000", 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9699999999999998e-05 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597344+0000", 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8380000000000008e-06 2024-09-18T10:31:45.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602728+0000", 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053844490000000004 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602764+0000", 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5884999999999999e-05 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.543 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:413 3.0s0 3:0a6b7166:::smithi16036501-28:head [append 0~0] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628873+0000", 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.8541450150000003, 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0065644930000000002, 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 413 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.544 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628873+0000", 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628873+0000", 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628870+0000", 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.545 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628882+0000", 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2048999999999999e-05 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628902+0000", 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0018e-05 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628911+0000", 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3939999999999996e-06 2024-09-18T10:31:45.546 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628968+0000", 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7089000000000002e-05 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op must wait for map", 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628974+0000", 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.404e-06 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.547 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.630895+0000", 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001920726 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.630963+0000", 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8238000000000006e-05 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.631464+0000", 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000500874 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.548 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.634449+0000", 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002984792 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.635345+0000", 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00089566099999999996 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.635437+0000", 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2558000000000004e-05 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.549 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:414 3.0s0 3:0a6b7166:::smithi16036501-28:head [rollback 11] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628923+0000", 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.8540948530000003, 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.007169529, 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 414 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.550 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628923+0000", 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628923+0000", 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628922+0000", 2024-09-18T10:31:45.551 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628926+0000", 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6219999999999998e-06 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628938+0000", 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1902999999999999e-05 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.552 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628942+0000", 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.386e-06 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629017+0000", 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5044999999999997e-05 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629021+0000", 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0430000000000001e-06 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.553 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632063+0000", 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0030421480000000002 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632146+0000", 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2208999999999998e-05 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.632796+0000", 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00065000400000000003 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.554 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.634576+0000", 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001780137 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636028+0000", 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00145191 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636092+0000", 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4675e-05 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.555 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:415 3.0s0 3:0a6b7166:::smithi16036501-28:head [append 0~0] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.8540581979999997, 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079305439999999994, 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.556 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 415 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.557 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628962+0000", 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4690000000000002e-06 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628969+0000", 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9720000000000003e-06 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.558 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628973+0000", 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9740000000000004e-06 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629040+0000", 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6503999999999999e-05 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629043+0000", 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1329999999999999e-06 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.559 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633315+0000", 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042715519999999996 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633399+0000", 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4252999999999994e-05 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633789+0000", 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00039028199999999999 2024-09-18T10:31:45.560 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636113+0000", 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002324062 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636794+0000", 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00068055999999999998 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.561 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636890+0000", 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6304999999999994e-05 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:422 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~737280] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.8330973879999997, 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010997704000000001, 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.562 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 422 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.563 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649918+0000", 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650522+0000", 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00060473000000000005 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650543+0000", 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0928999999999999e-05 2024-09-18T10:31:45.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650551+0000", 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9699999999999999e-06 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650611+0000", 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0090000000000002e-05 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op must wait for map", 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650621+0000", 2024-09-18T10:31:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6739999999999992e-06 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.652641+0000", 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020202430000000001 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.652748+0000", 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000106977 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654248+0000", 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001500028 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660764+0000", 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006516127 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660831+0000", 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6540999999999999e-05 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660918+0000", 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6994000000000001e-05 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:423 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~573440] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.8298535469999999, 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0093190359999999993, 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.568 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 423 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:31:45.569 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653163+0000", 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653853+0000", 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00069050600000000002 2024-09-18T10:31:45.570 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653868+0000", 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.524e-05 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653879+0000", 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0584999999999999e-05 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.656943+0000", 2024-09-18T10:31:45.571 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003063985 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657047+0000", 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103649 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657886+0000", 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00083983699999999996 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.572 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661372+0000", 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034854690000000002 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662421+0000", 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001048736 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662483+0000", 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2453999999999995e-05 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.573 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:424 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~196608] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.8280078069999997, 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096355950000000003, 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 424 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.574 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655009+0000", 2024-09-18T10:31:45.575 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655125+0000", 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000116648 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655139+0000", 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3869000000000001e-05 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.576 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655146+0000", 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0360000000000001e-06 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658784+0000", 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036375840000000001 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658889+0000", 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00010497600000000001 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.577 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.659461+0000", 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00057189199999999995 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661374+0000", 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001913849 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664576+0000", 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003202004 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.578 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664645+0000", 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9060999999999995e-05 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:425 3.0s0 3:0d48e6bb:::smithi16036501-38:head [setxattr _header (57) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.8278642779999998, 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096364109999999992, 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.579 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 425 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.580 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655156+0000", 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5190000000000001e-06 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.581 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655163+0000", 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3759999999999996e-06 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655167+0000", 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9400000000000004e-06 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.659827+0000", 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046608539999999999 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.582 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660123+0000", 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00029602200000000001 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660525+0000", 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040106499999999998 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662166+0000", 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001641595 2024-09-18T10:31:45.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664727+0000", 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025612529999999999 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664790+0000", 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2372000000000005e-05 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.584 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:426 3.0s0 3:0d48e6bb:::smithi16036501-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.8278469839999998, 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011075404, 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 426 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.585 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655170+0000", 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.586 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655178+0000", 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8469999999999996e-06 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655185+0000", 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7510000000000002e-06 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655189+0000", 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9570000000000004e-06 2024-09-18T10:31:45.587 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661136+0000", 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059469930000000002 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661287+0000", 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00015076999999999999 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.665373+0000", 2024-09-18T10:31:45.588 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0040862720000000002 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.665456+0000", 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2935000000000005e-05 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.666246+0000", 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00079023899999999998 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.589 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.590 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.590 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:45.591 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:45.591 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:45.590+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:45.598 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.14 to 1 (10000) 2024-09-18T10:31:45.599 INFO:tasks.rados.rados.0.smithi160.stdout:187: done (2 left) 2024-09-18T10:31:45.599 INFO:tasks.rados.rados.0.smithi160.stdout:188: done (1 left) 2024-09-18T10:31:45.599 INFO:tasks.rados.rados.0.smithi160.stdout:189: done (0 left) 2024-09-18T10:31:45.599 INFO:tasks.rados.rados.0.smithi160.stdout:190: rollback oid 8 current snap is 14 2024-09-18T10:31:45.600 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 8 to 3 2024-09-18T10:31:45.600 INFO:tasks.rados.rados.0.smithi160.stdout:191: rmattr oid 2 current snap is 14 2024-09-18T10:31:45.600 INFO:tasks.rados.rados.0.smithi160.stdout:192: read oid 41 snap -1 2024-09-18T10:31:45.600 INFO:tasks.rados.rados.0.smithi160.stdout:192: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-18T10:31:45.600 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 43 current snap is 14 2024-09-18T10:31:45.600 INFO:tasks.rados.rados.0.smithi160.stdout:193: seq_num 98 ranges {720896=491520,1212416=589824,1802240=557056,2359296=16384} 2024-09-18T10:31:45.605 INFO:tasks.rados.rados.0.smithi160.stdout:193: writing smithi16036501-43 from 720896 to 1212416 tid 1 2024-09-18T10:31:45.609 INFO:tasks.rados.rados.0.smithi160.stdout:193: writing smithi16036501-43 from 1212416 to 1802240 tid 2 2024-09-18T10:31:45.613 INFO:tasks.rados.rados.0.smithi160.stdout:193: writing smithi16036501-43 from 1802240 to 2359296 tid 3 2024-09-18T10:31:45.613 INFO:tasks.rados.rados.0.smithi160.stdout:193: writing smithi16036501-43 from 2359296 to 2375680 tid 4 2024-09-18T10:31:45.613 INFO:tasks.rados.rados.0.smithi160.stdout:194: read oid 21 snap -1 2024-09-18T10:31:45.613 INFO:tasks.rados.rados.0.smithi160.stdout:194: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:45.613 INFO:tasks.rados.rados.0.smithi160.stdout:195: snap_remove snap 12 2024-09-18T10:31:45.616 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:31:45.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-18T10:31:45.692 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:45.690+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:45.698 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:45.699 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:45.699 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:45.699 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:45.707 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:45.793 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:45.792+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:45.846 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:45.846 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:45.846 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:45.846 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:45.846 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:45.854 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:45.894 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:45.893+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:45.993 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:45.993 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:45.993 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:45.993 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:45.993 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.993 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 44/33 ECSubWrite(tid=29, reqid=osd.3.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=44'18))", 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.321308+0000", 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 16.669973304999999, 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003276555, 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321308+0000", 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.994 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321308+0000", 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321307+0000", 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321320+0000", 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2850999999999999e-05 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.995 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321334+0000", 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3997e-05 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321341+0000", 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.199e-06 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321375+0000", 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3713000000000001e-05 2024-09-18T10:31:45.996 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321384+0000", 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3179999999999996e-06 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324551+0000", 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0031663289999999998 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324585+0000", 2024-09-18T10:31:45.997 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4155000000000001e-05 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:30.340614+0000", 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.650667984, 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032890279999999998, 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:45.998 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.340614+0000", 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.340614+0000", 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.340613+0000", 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:45.999 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342103+0000", 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0014893619999999999 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342117+0000", 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4153e-05 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.000 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342125+0000", 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4530000000000002e-06 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342202+0000", 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6966999999999997e-05 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.001 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.342214+0000", 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1573000000000001e-05 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.343876+0000", 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0016618 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.002 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:30.343903+0000", 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6923999999999998e-05 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.395923254, 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039367780000000002, 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.003 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:31:46.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595367+0000", 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6660000000000003e-06 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595378+0000", 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0883999999999999e-05 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.005 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595384+0000", 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5659999999999997e-06 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595422+0000", 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8557999999999999e-05 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595434+0000", 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1573000000000001e-05 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.006 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599270+0000", 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038357019999999999 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599295+0000", 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5622999999999998e-05 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=29, reqid=client.4589.0:366, at_version=49'20, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:46.007 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.395196607999999, 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003225169, 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.008 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596085+0000", 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596108+0000", 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2972e-05 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.009 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596119+0000", 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1358e-05 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596126+0000", 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6649999999999997e-06 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596172+0000", 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6372999999999998e-05 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.010 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.596181+0000", 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8610000000000004e-06 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599298+0000", 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003117159 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599310+0000", 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2014999999999999e-05 2024-09-18T10:31:46.011 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 49/33 ECSubWrite(tid=41, reqid=osd.3.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=49'29))", 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.387249316, 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056101689999999999, 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.012 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.013 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604042+0000", 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0319999999999999e-05 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604052+0000", 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6830000000000003e-06 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:31:46.014 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2500000000000003e-06 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604104+0000", 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5391e-05 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604112+0000", 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6780000000000006e-06 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.015 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609618+0000", 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055057309999999998 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609643+0000", 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4572000000000001e-05 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.016 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 49/33 ECSubWrite(tid=169, reqid=osd.4.0:168, at_version=0'0, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.386845384000001, 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051417169999999996, 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604435+0000", 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604448+0000", 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2131e-05 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.018 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604459+0000", 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1649e-05 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604466+0000", 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4799999999999998e-06 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604513+0000", 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7036999999999997e-05 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.019 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604523+0000", 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0118999999999999e-05 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609552+0000", 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050292749999999997 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609578+0000", 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5811000000000001e-05 2024-09-18T10:31:46.020 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=31, reqid=osd.8.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.386711244000001, 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055933889999999998, 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.021 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604569+0000", 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.022 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604584+0000", 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5183e-05 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604599+0000", 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4738e-05 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.023 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604606+0000", 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8390000000000001e-06 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604658+0000", 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2009000000000003e-05 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604667+0000", 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4269999999999997e-06 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.024 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610148+0000", 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054800889999999996 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610164+0000", 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6271999999999999e-05 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.025 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.384451423, 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054572869999999999, 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.026 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606829+0000", 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606859+0000", 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9223000000000001e-05 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.027 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606874+0000", 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606880+0000", 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5400000000000001e-06 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606942+0000", 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1527999999999998e-05 2024-09-18T10:31:46.028 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606952+0000", 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0139999999999999e-05 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612246+0000", 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052944999999999997 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.029 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612288+0000", 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1016000000000002e-05 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=32, reqid=client.4589.0:367, at_version=49'24, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 12.383780253999999, 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051511930000000001, 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.030 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:31:46.031 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607667+0000", 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000166269 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607677+0000", 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.397e-06 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.032 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607681+0000", 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2139999999999998e-06 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607714+0000", 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3355999999999997e-05 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607723+0000", 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9719999999999998e-06 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.033 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612630+0000", 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049068009999999997 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612653+0000", 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2731999999999999e-05 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.034 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 54/33 ECSubWrite(tid=40, reqid=client.4589.0:419, at_version=54'33, trim_to=0'0, roll_forward_to=54'31))", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 7.3385074330000002, 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0033514149999999999, 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:46.035 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652774+0000", 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652790+0000", 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5953000000000001e-05 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.036 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652798+0000", 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6780000000000006e-06 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652802+0000", 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.873e-06 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652848+0000", 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5626e-05 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.652855+0000", 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.452e-06 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.656106+0000", 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032503480000000001 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.656126+0000", 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0071000000000001e-05 2024-09-18T10:31:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 55/33 ECSubWrite(tid=54, reqid=client.4589.0:422, at_version=55'42, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.654186+0000", 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.3370960829999996, 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0033310459999999998, 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654186+0000", 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654186+0000", 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654185+0000", 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654315+0000", 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000130097 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654327+0000", 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2092999999999999e-05 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654336+0000", 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5650000000000002e-06 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654397+0000", 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1315000000000005e-05 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654411+0000", 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3698e-05 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657493+0000", 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0030824680000000001 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657517+0000", 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3340999999999999e-05 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 55/33 ECSubWrite(tid=56, reqid=client.4589.0:423, at_version=55'45, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.658222+0000", 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.3330592479999996, 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0035135890000000001, 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658222+0000", 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658222+0000", 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658222+0000", 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658334+0000", 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000112735 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658343+0000", 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.7569999999999993e-06 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658349+0000", 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3360000000000002e-06 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658385+0000", 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6538000000000002e-05 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658393+0000", 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.0960000000000001e-06 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661713+0000", 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0033195500000000001 2024-09-18T10:31:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661736+0000", 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3285000000000002e-05 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 55/33 ECSubWrite(tid=57, reqid=client.4589.0:424, at_version=55'46, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.660367+0000", 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.3309149170000003, 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039998530000000003, 2024-09-18T10:31:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660367+0000", 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660367+0000", 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660366+0000", 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660425+0000", 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8897000000000002e-05 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660439+0000", 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4412e-05 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660445+0000", 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0390000000000001e-06 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660492+0000", 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7225000000000003e-05 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660503+0000", 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0788000000000001e-05 2024-09-18T10:31:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664344+0000", 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038410739999999999 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664367+0000", 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2399e-05 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 55/33 ECSubWrite(tid=58, reqid=client.4589.0:425, at_version=55'47, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.661110+0000", 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.3301721479999999, 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0032692770000000001, 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661110+0000", 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661110+0000", 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661109+0000", 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661125+0000", 2024-09-18T10:31:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6084999999999999e-05 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661140+0000", 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5033e-05 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661146+0000", 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.9159999999999998e-06 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661231+0000", 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4713e-05 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661240+0000", 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3589999999999997e-06 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664370+0000", 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003129738 2024-09-18T10:31:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664379+0000", 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0690000000000008e-06 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 55/33 ECSubWrite(tid=77, reqid=client.4589.0:450, at_version=55'32, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.210690005, 2024-09-18T10:31:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046866, 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781300+0000", 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00070876399999999997 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781311+0000", 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0360000000000001e-05 2024-09-18T10:31:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781316+0000", 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.0529999999999997e-06 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781356+0000", 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9888000000000002e-05 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.060 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781362+0000", 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8820000000000003e-06 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.785253+0000", 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038900670000000001 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.785278+0000", 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5712e-05 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 56/33 ECSubWrite(tid=45, reqid=osd.8.0:45, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.3529998159999996, 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003599859, 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.062 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638294+0000", 2024-09-18T10:31:46.063 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1929e-05 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638301+0000", 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1949999999999997e-06 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638305+0000", 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2039999999999999e-06 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.064 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638361+0000", 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5498999999999998e-05 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638373+0000", 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2071e-05 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.641856+0000", 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003482958 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.641882+0000", 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6115e-05 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 56/33 ECSubWrite(tid=63, reqid=osd.3.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=56'51))", 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.350933597, 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042165529999999996, 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.066 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.067 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640347+0000", 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1082e-05 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640372+0000", 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3559e-05 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.068 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640378+0000", 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5209999999999999e-06 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640427+0000", 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8717999999999997e-05 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640438+0000", 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0793e-05 2024-09-18T10:31:46.069 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.644544+0000", 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041064129999999997 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.644565+0000", 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0265999999999999e-05 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.070 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/33 ECSubWrite(tid=236, reqid=client.4589.0:490, at_version=60'36, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.600794+0000", 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 1.3904873119999999, 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0033783530000000002, 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.600794+0000", 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.071 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.600794+0000", 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.600794+0000", 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.600817+0000", 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3427000000000001e-05 2024-09-18T10:31:46.072 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.600827+0000", 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4210000000000001e-06 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.600835+0000", 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8220000000000007e-06 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.073 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.602169+0000", 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0013339840000000001 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.602180+0000", 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1557e-05 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.604135+0000", 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0019548 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.074 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.604173+0000", 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7832e-05 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 60/33 ECSubWrite(tid=74, reqid=osd.3.0:73, at_version=0'0, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 1.3782670180000001, 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051941000000000001, 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.075 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613014+0000", 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.076 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613026+0000", 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2536e-05 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613041+0000", 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4487999999999999e-05 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613065+0000", 2024-09-18T10:31:46.077 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4145e-05 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613135+0000", 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0297999999999997e-05 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613145+0000", 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0288999999999999e-05 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.078 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618182+0000", 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050361340000000003 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618209+0000", 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7146000000000001e-05 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 60/33 ECSubWrite(tid=75, reqid=osd.3.0:75, at_version=60'64, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:31:46.079 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 1.3774305980000001, 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0043719620000000001, 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:31:46.080 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613850+0000", 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613869+0000", 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9038999999999998e-05 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.081 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613882+0000", 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2539e-05 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613888+0000", 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.806e-06 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613928+0000", 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0584000000000003e-05 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.082 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613936+0000", 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9219999999999997e-06 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618212+0000", 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042758199999999996 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618223+0000", 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1009000000000001e-05 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.083 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.084 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.084 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.084 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.084 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:46.085 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:46.086 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:46.084+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:46.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:46.184 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:46.184 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:46.184 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:46.184 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:46.186 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:46.185+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:46.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:46.262 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:46.263 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:46.279 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:46.280 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:46.287 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:46.286+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:46.295 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:46.296 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:46.311 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:46.311 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:46.326 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:46.326 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:46.331 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:46.331 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:46.331 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:46.331 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:46.331 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:46.340 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:46.342 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:46.342 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:46.358 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:46.358 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:46.375 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:46.375 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:46.387 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:46.386+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:46.389 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:46.389 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:46.405 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:46.406 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:46.421 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:46.422 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:46.437 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:46.452 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:46.453 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:46.478 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:46.478 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:46.486 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:31:46.488 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:46.487+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:46.584 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:46.584 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:46.585 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:31:46.585 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:46.589 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:46.588+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:46.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:31:46.600 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:31:46.600 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.15 to 1 (10000) 2024-09-18T10:31:46.601 INFO:tasks.rados.rados.0.smithi160.stdout:195: done (5 left) 2024-09-18T10:31:46.601 INFO:tasks.rados.rados.0.smithi160.stdout:196: snap_remove snap 13 2024-09-18T10:31:46.619 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T10:31:46.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:46.670 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:46.670 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:46.685 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:46.686 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:46.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:46.685+0000 7f87088ba640 0 -- 172.21.15.63:0/389214239 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7f8704197eb0 msgr2=0x7f870419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:46.690 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:46.689+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:46.701 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:46.701 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:46.701 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:46.701 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:46.701 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:46.709 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:31:46.791 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:46.790+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:46.808 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:41 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'23, mlcod=24'19)", 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.810794696000002, 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055352270000000002, 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.809 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996042+0000", 2024-09-18T10:31:46.810 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996105+0000", 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3058999999999994e-05 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996120+0000", 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4555999999999999e-05 2024-09-18T10:31:46.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996126+0000", 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1550000000000004e-06 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996159+0000", 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3147e-05 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.812 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996172+0000", 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2802e-05 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001546+0000", 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053743339999999997 2024-09-18T10:31:46.816 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001578+0000", 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1952000000000002e-05 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:42 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'24, mlcod=24'19)", 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.810338449, 2024-09-18T10:31:46.817 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050999269999999998, 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.818 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996499+0000", 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996515+0000", 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6300999999999999e-05 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.819 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996523+0000", 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.1079999999999993e-06 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996532+0000", 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5059999999999995e-06 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996567+0000", 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5596999999999998e-05 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.820 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996587+0000", 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9828999999999999e-05 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001580+0000", 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049931979999999999 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001599+0000", 2024-09-18T10:31:46.821 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8725000000000001e-05 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:50 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'32, mlcod=24'21)", 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.805825171000002, 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058482279999999996, 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.822 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001012+0000", 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.823 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001087+0000", 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5179999999999995e-05 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001097+0000", 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0253e-05 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001105+0000", 2024-09-18T10:31:46.824 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9410000000000007e-06 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001141+0000", 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5515999999999997e-05 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001162+0000", 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0917999999999999e-05 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.825 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006825+0000", 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056635110000000004 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006861+0000", 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5673000000000002e-05 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:51 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'33, mlcod=24'21)", 2024-09-18T10:31:46.826 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.805281328, 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053261339999999997, 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.827 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001556+0000", 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001563+0000", 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1199999999999996e-06 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.828 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001574+0000", 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1612e-05 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001580+0000", 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4779999999999999e-06 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001721+0000", 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000141409 2024-09-18T10:31:46.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001735+0000", 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3767999999999999e-05 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006863+0000", 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051274720000000001 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.830 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006883+0000", 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0006000000000001e-05 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:52 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'34, mlcod=24'21)", 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.804904078, 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049710359999999999, 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.831 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001934+0000", 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.832 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001933+0000", 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001939+0000", 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2859999999999996e-06 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001948+0000", 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6559999999999998e-06 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.833 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001952+0000", 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6239999999999999e-06 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001986+0000", 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4764000000000001e-05 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.002005+0000", 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8576e-05 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.834 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006885+0000", 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004879904 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006905+0000", 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9792e-05 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.835 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:71 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'49, mlcod=25'45)", 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.673031383999998, 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060683170000000002, 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.836 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.837 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133811+0000", 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4179999999999996e-06 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133820+0000", 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9050000000000003e-06 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133824+0000", 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3969999999999998e-06 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.838 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133864+0000", 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0028999999999999e-05 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133883+0000", 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9049e-05 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139840+0000", 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059569510000000003 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.839 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139875+0000", 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5117000000000003e-05 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:72 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'50, mlcod=25'45)", 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.672623092000002, 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056771290000000004, 2024-09-18T10:31:46.840 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.841 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134214+0000", 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134252+0000", 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7412e-05 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134261+0000", 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.842 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134271+0000", 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0716999999999999e-05 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134305+0000", 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4031e-05 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134325+0000", 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9318e-05 2024-09-18T10:31:46.843 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139878+0000", 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055528139999999997 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139892+0000", 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4192999999999999e-05 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.844 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:73 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'51, mlcod=25'45)", 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.672107507, 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051763119999999998, 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.845 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134730+0000", 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134734+0000", 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1500000000000001e-06 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.846 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134741+0000", 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5420000000000002e-06 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134744+0000", 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9699999999999999e-06 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136224+0000", 2024-09-18T10:31:46.847 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001480234 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136236+0000", 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2357e-05 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139893+0000", 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036565059999999999 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.848 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139907+0000", 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3910999999999999e-05 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:75 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'53, mlcod=25'45)", 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.671354825999998, 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070322270000000003, 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.849 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.850 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135546+0000", 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3405999999999996e-05 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135554+0000", 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5780000000000001e-06 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.851 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135557+0000", 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.912e-06 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136700+0000", 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00114241 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136711+0000", 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1445e-05 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.852 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142483+0000", 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057715509999999998 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142515+0000", 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2313e-05 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.853 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:76 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'54, mlcod=25'45)", 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.670757975000001, 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091963210000000004, 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.854 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136079+0000", 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136090+0000", 2024-09-18T10:31:46.855 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0294e-05 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136096+0000", 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5549999999999999e-06 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136099+0000", 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1650000000000002e-06 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.856 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139649+0000", 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0035492869999999999 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139663+0000", 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4232e-05 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145234+0000", 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055716799999999999 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.857 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145276+0000", 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1618e-05 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:79 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'57, mlcod=25'53)", 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.659733266000003, 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057630829999999996, 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.858 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147180+0000", 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6073000000000002e-05 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147189+0000", 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4460000000000001e-06 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147192+0000", 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6349999999999999e-06 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147225+0000", 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3318000000000002e-05 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147240+0000", 2024-09-18T10:31:46.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4397e-05 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152821+0000", 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005580616 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152868+0000", 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7043999999999999e-05 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.862 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:80 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'58, mlcod=25'53)", 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 43.659308985000003, 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053579960000000003, 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.863 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147529+0000", 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147528+0000", 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147600+0000", 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.2118000000000003e-05 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147609+0000", 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8189999999999998e-06 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147613+0000", 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8410000000000002e-06 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147643+0000", 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0179999999999999e-05 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147656+0000", 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2843999999999999e-05 2024-09-18T10:31:46.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152871+0000", 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052145810000000003 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152887+0000", 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6124e-05 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 22.527182883000002, 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055838909999999997, 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:46.868 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280401+0000", 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074599499999999995 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280415+0000", 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4711e-05 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280422+0000", 2024-09-18T10:31:46.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6209999999999998e-06 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280486+0000", 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3670999999999994e-05 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280494+0000", 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8599999999999993e-06 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285203+0000", 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047090980000000001 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285239+0000", 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6112999999999998e-05 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:46.872 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 17.493471537000001, 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050229960000000001, 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:46.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313366+0000", 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313389+0000", 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3708000000000001e-05 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313401+0000", 2024-09-18T10:31:46.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1531e-05 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313408+0000", 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1029999999999996e-06 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313454+0000", 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6489999999999997e-05 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.313463+0000", 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318360+0000", 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0048972959999999998 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.318389+0000", 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8866000000000001e-05 2024-09-18T10:31:46.876 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s4 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 17.484205948, 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056939590000000002, 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.877 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322631+0000", 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322653+0000", 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1883e-05 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322665+0000", 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2434e-05 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322672+0000", 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1799999999999999e-06 2024-09-18T10:31:46.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322722+0000", 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9963999999999998e-05 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322730+0000", 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0859999999999996e-06 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328297+0000", 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005567326 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328326+0000", 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8915e-05 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s1 49/33 ECSubWrite(tid=29, reqid=client.4589.0:366, at_version=49'20, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:46.881 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 13.209519652999999, 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053532370000000003, 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597318+0000", 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597340+0000", 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1817000000000001e-05 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597348+0000", 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.5040000000000002e-06 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597354+0000", 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7300000000000002e-06 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597400+0000", 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6319000000000002e-05 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597410+0000", 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6339999999999996e-06 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602646+0000", 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005235707 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602671+0000", 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5683000000000001e-05 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.885 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 49/33 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=49'50, trim_to=0'0, roll_forward_to=47'48))", 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 13.209477414, 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053254119999999999, 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.886 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597360+0000", 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.887 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597379+0000", 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8964999999999999e-05 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597387+0000", 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3890000000000005e-06 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597394+0000", 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.669e-06 2024-09-18T10:31:46.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597448+0000", 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3860999999999998e-05 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597457+0000", 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0070000000000003e-06 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602662+0000", 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052053289999999999 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.602686+0000", 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3453000000000001e-05 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s1 49/33 ECSubWrite(tid=30, reqid=osd.8.0:30, at_version=49'22, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:46.890 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 13.209472400999999, 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060374210000000003, 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.891 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597379+0000", 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3862999999999999e-05 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.892 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597387+0000", 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9149999999999996e-06 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597391+0000", 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8310000000000003e-06 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599813+0000", 2024-09-18T10:31:46.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024224110000000002 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599822+0000", 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8610000000000004e-06 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603383+0000", 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003560798 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603403+0000", 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9915000000000002e-05 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 13.209337251999999, 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0061865829999999998, 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.895 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597519+0000", 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8604e-05 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597527+0000", 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3760000000000008e-06 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.897 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597532+0000", 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9779999999999996e-06 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597587+0000", 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4666000000000001e-05 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597597+0000", 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0448999999999999e-05 2024-09-18T10:31:46.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603670+0000", 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060726390000000003 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603687+0000", 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7345000000000001e-05 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 49/33 ECSubWrite(tid=65, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604154+0000", 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 13.202684196, 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054359229999999996, 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.900 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:46.901 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604154+0000", 2024-09-18T10:31:46.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604154+0000", 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604153+0000", 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:46.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604162+0000", 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6659999999999997e-06 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604171+0000", 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6779999999999995e-06 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604177+0000", 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8300000000000001e-06 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.903 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604610+0000", 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00043294399999999999 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604619+0000", 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.0219999999999993e-06 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:46.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609563+0000", 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049438700000000004 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609589+0000", 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6353e-05 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:46.905 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:46.907 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:46.906+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:46.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:46.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:46.910 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:46.911 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:46.912 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:46.913 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-18T10:31:46.620074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":59687475,"num_objects":85,"num_object_clones":36,"num_object_copies":575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":6,"num_read":317,"num_read_kb":50463,"num_write":581,"num_write_kb":69890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":4870992,"kb_used_data":113204,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505078448,"statfs":{"total":1546188226560,"available":1541200330752,"internally_reserved":0,"allocated":115920896,"data_stored":142732906,"data_compressed":1827602,"data_compressed_allocated":2572288,"data_compressed_original":6037504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3276800,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000740"},"pg_stats":[{"pgid":"3.f","version":"60'64","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.629734+0000","last_change":"2024-09-18T10:31:44.629734+0000","last_active":"2024-09-18T10:31:44.629734+0000","last_peered":"2024-09-18T10:31:44.629734+0000","last_clean":"2024-09-18T10:31:44.629734+0000","last_became_active":"2024-09-18T10:31:19.653467+0000","last_became_peered":"2024-09-18T10:31:19.653467+0000","last_unstale":"2024-09-18T10:31:44.629734+0000","last_undegraded":"2024-09-18T10:31:44.629734+0000","last_fullsized":"2024-09-18T10:31:44.629734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.811199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028072541999999999,"stat_sum":{"num_bytes":7618560,"num_objects":10,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":21,"num_read_kb":5099,"num_write":49,"num_write_kb":7440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.e","version":"44'11","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.595333+0000","last_change":"2024-09-18T10:31:44.595333+0000","last_active":"2024-09-18T10:31:44.595333+0000","last_peered":"2024-09-18T10:31:44.595333+0000","last_clean":"2024-09-18T10:31:44.595333+0000","last_became_active":"2024-09-18T10:31:19.655410+0000","last_became_peered":"2024-09-18T10:31:19.655410+0000","last_unstale":"2024-09-18T10:31:44.595333+0000","last_undegraded":"2024-09-18T10:31:44.595333+0000","last_fullsized":"2024-09-18T10:31:44.595333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.418469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047950400000000001,"stat_sum":{"num_bytes":983040,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2884,"num_write":7,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.d","version":"61'12","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-18T10:31:45.600777+0000","last_change":"2024-09-18T10:31:44.611488+0000","last_active":"2024-09-18T10:31:45.600777+0000","last_peered":"2024-09-18T10:31:45.600777+0000","last_clean":"2024-09-18T10:31:45.600777+0000","last_became_active":"2024-09-18T10:31:19.658019+0000","last_became_peered":"2024-09-18T10:31:19.658019+0000","last_unstale":"2024-09-18T10:31:45.600777+0000","last_undegraded":"2024-09-18T10:31:45.600777+0000","last_fullsized":"2024-09-18T10:31:45.600777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.132541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845533,"stat_sum":{"num_bytes":32768,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":29,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.c","version":"60'45","reported_seq":136,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.612240+0000","last_change":"2024-09-18T10:31:44.612240+0000","last_active":"2024-09-18T10:31:44.612240+0000","last_peered":"2024-09-18T10:31:44.612240+0000","last_clean":"2024-09-18T10:31:44.612240+0000","last_became_active":"2024-09-18T10:31:19.654704+0000","last_became_peered":"2024-09-18T10:31:19.654704+0000","last_unstale":"2024-09-18T10:31:44.612240+0000","last_undegraded":"2024-09-18T10:31:44.612240+0000","last_fullsized":"2024-09-18T10:31:44.612240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:40.031783+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.015098957,"stat_sum":{"num_bytes":5652480,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":18,"num_read_kb":4041,"num_write":23,"num_write_kb":5520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.b","version":"60'78","reported_seq":167,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.623818+0000","last_change":"2024-09-18T10:31:44.624967+0000","last_active":"2024-09-18T10:31:44.623818+0000","last_peered":"2024-09-18T10:31:44.623818+0000","last_clean":"2024-09-18T10:31:44.623818+0000","last_became_active":"2024-09-18T10:31:19.659120+0000","last_became_peered":"2024-09-18T10:31:19.659120+0000","last_unstale":"2024-09-18T10:31:44.623818+0000","last_undegraded":"2024-09-18T10:31:44.623818+0000","last_fullsized":"2024-09-18T10:31:44.623818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.157665+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.027359209999999998,"stat_sum":{"num_bytes":9715712,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":22,"num_read_kb":2172,"num_write":36,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.a","version":"60'35","reported_seq":125,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.607280+0000","last_change":"2024-09-18T10:31:44.607280+0000","last_active":"2024-09-18T10:31:44.607280+0000","last_peered":"2024-09-18T10:31:44.607280+0000","last_clean":"2024-09-18T10:31:44.607280+0000","last_became_active":"2024-09-18T10:31:19.656939+0000","last_became_peered":"2024-09-18T10:31:19.656939+0000","last_unstale":"2024-09-18T10:31:44.607280+0000","last_undegraded":"2024-09-18T10:31:44.607280+0000","last_fullsized":"2024-09-18T10:31:44.607280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.835368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075513009999999998,"stat_sum":{"num_bytes":2441216,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":1685,"num_write":52,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.9","version":"36'3","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.602777+0000","last_change":"2024-09-18T10:31:44.602777+0000","last_active":"2024-09-18T10:31:44.602777+0000","last_peered":"2024-09-18T10:31:44.602777+0000","last_clean":"2024-09-18T10:31:44.602777+0000","last_became_active":"2024-09-18T10:31:19.656490+0000","last_became_peered":"2024-09-18T10:31:19.656490+0000","last_unstale":"2024-09-18T10:31:44.602777+0000","last_undegraded":"2024-09-18T10:31:44.602777+0000","last_fullsized":"2024-09-18T10:31:44.602777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.159673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001465493,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.8","version":"44'9","reported_seq":99,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.594748+0000","last_change":"2024-09-18T10:31:44.594748+0000","last_active":"2024-09-18T10:31:44.594748+0000","last_peered":"2024-09-18T10:31:44.594748+0000","last_clean":"2024-09-18T10:31:44.594748+0000","last_became_active":"2024-09-18T10:31:19.656901+0000","last_became_peered":"2024-09-18T10:31:19.656901+0000","last_unstale":"2024-09-18T10:31:44.594748+0000","last_undegraded":"2024-09-18T10:31:44.594748+0000","last_fullsized":"2024-09-18T10:31:44.594748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:24.257154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407300000000001,"stat_sum":{"num_bytes":1343488,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":8,"num_read_kb":1587,"num_write":6,"num_write_kb":1312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.594411+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:44.594411+0000","last_peered":"2024-09-18T10:31:44.594411+0000","last_clean":"2024-09-18T10:31:44.594411+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:44.594411+0000","last_undegraded":"2024-09-18T10:31:44.594411+0000","last_fullsized":"2024-09-18T10:31:44.594411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600837+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:44.600837+0000","last_peered":"2024-09-18T10:31:44.600837+0000","last_clean":"2024-09-18T10:31:44.600837+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:44.600837+0000","last_undegraded":"2024-09-18T10:31:44.600837+0000","last_fullsized":"2024-09-18T10:31:44.600837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"44'10","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.601241+0000","last_change":"2024-09-18T10:31:44.601241+0000","last_active":"2024-09-18T10:31:44.601241+0000","last_peered":"2024-09-18T10:31:44.601241+0000","last_clean":"2024-09-18T10:31:44.601241+0000","last_became_active":"2024-09-18T10:31:19.656832+0000","last_became_peered":"2024-09-18T10:31:19.656832+0000","last_unstale":"2024-09-18T10:31:44.601241+0000","last_undegraded":"2024-09-18T10:31:44.601241+0000","last_fullsized":"2024-09-18T10:31:44.601241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:45.003864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051836099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.604467+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:44.604467+0000","last_peered":"2024-09-18T10:31:44.604467+0000","last_clean":"2024-09-18T10:31:44.604467+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:44.604467+0000","last_undegraded":"2024-09-18T10:31:44.604467+0000","last_fullsized":"2024-09-18T10:31:44.604467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"60'36","reported_seq":138,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.608281+0000","last_change":"2024-09-18T10:31:44.602234+0000","last_active":"2024-09-18T10:31:44.608281+0000","last_peered":"2024-09-18T10:31:44.608281+0000","last_clean":"2024-09-18T10:31:44.608281+0000","last_became_active":"2024-09-18T10:31:19.657050+0000","last_became_peered":"2024-09-18T10:31:19.657050+0000","last_unstale":"2024-09-18T10:31:44.608281+0000","last_undegraded":"2024-09-18T10:31:44.608281+0000","last_fullsized":"2024-09-18T10:31:44.608281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.836363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046776320000000001,"stat_sum":{"num_bytes":5275648,"num_objects":8,"num_object_clones":3,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":26,"num_read_kb":7114,"num_write":22,"num_write_kb":5536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600660+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:44.600660+0000","last_peered":"2024-09-18T10:31:44.600660+0000","last_clean":"2024-09-18T10:31:44.600660+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:44.600660+0000","last_undegraded":"2024-09-18T10:31:44.600660+0000","last_fullsized":"2024-09-18T10:31:44.600660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"60'64","reported_seq":151,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.622870+0000","last_change":"2024-09-18T10:31:44.622870+0000","last_active":"2024-09-18T10:31:44.622870+0000","last_peered":"2024-09-18T10:31:44.622870+0000","last_clean":"2024-09-18T10:31:44.622870+0000","last_became_active":"2024-09-18T10:31:19.653500+0000","last_became_peered":"2024-09-18T10:31:19.653500+0000","last_unstale":"2024-09-18T10:31:44.622870+0000","last_undegraded":"2024-09-18T10:31:44.622870+0000","last_fullsized":"2024-09-18T10:31:44.622870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.537620+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.021388885999999999,"stat_sum":{"num_bytes":9453568,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":34,"num_write_kb":10672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.599858+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:44.599858+0000","last_peered":"2024-09-18T10:31:44.599858+0000","last_clean":"2024-09-18T10:31:44.599858+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:44.599858+0000","last_undegraded":"2024-09-18T10:31:44.599858+0000","last_fullsized":"2024-09-18T10:31:44.599858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.609696+0000","last_change":"2024-09-18T10:31:44.609696+0000","last_active":"2024-09-18T10:31:44.609696+0000","last_peered":"2024-09-18T10:31:44.609696+0000","last_clean":"2024-09-18T10:31:44.609696+0000","last_became_active":"2024-09-18T10:31:19.653308+0000","last_became_peered":"2024-09-18T10:31:19.653308+0000","last_unstale":"2024-09-18T10:31:44.609696+0000","last_undegraded":"2024-09-18T10:31:44.609696+0000","last_fullsized":"2024-09-18T10:31:44.609696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.003091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020009110000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.5","version":"60'32","reported_seq":120,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.606846+0000","last_change":"2024-09-18T10:31:44.606846+0000","last_active":"2024-09-18T10:31:44.606846+0000","last_peered":"2024-09-18T10:31:44.606846+0000","last_clean":"2024-09-18T10:31:44.606846+0000","last_became_active":"2024-09-18T10:31:19.654834+0000","last_became_peered":"2024-09-18T10:31:19.654834+0000","last_unstale":"2024-09-18T10:31:44.606846+0000","last_undegraded":"2024-09-18T10:31:44.606846+0000","last_fullsized":"2024-09-18T10:31:44.606846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:30.217482+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0095991150000000001,"stat_sum":{"num_bytes":540672,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":10,"num_read_kb":5,"num_write":17,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T10:31:43.594650+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:43.594650+0000","last_peered":"2024-09-18T10:31:43.594650+0000","last_clean":"2024-09-18T10:31:43.594650+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:43.594650+0000","last_undegraded":"2024-09-18T10:31:43.594650+0000","last_fullsized":"2024-09-18T10:31:43.594650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"60'48","reported_seq":138,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.617537+0000","last_change":"2024-09-18T10:31:44.617537+0000","last_active":"2024-09-18T10:31:44.617537+0000","last_peered":"2024-09-18T10:31:44.617537+0000","last_clean":"2024-09-18T10:31:44.617537+0000","last_became_active":"2024-09-18T10:31:19.653632+0000","last_became_peered":"2024-09-18T10:31:19.653632+0000","last_unstale":"2024-09-18T10:31:44.617537+0000","last_undegraded":"2024-09-18T10:31:44.617537+0000","last_fullsized":"2024-09-18T10:31:44.617537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:42.743288+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.017228988000000001,"stat_sum":{"num_bytes":4833280,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":15,"num_read_kb":6391,"num_write":38,"num_write_kb":4720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600979+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:44.600979+0000","last_peered":"2024-09-18T10:31:44.600979+0000","last_clean":"2024-09-18T10:31:44.600979+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:44.600979+0000","last_undegraded":"2024-09-18T10:31:44.600979+0000","last_fullsized":"2024-09-18T10:31:44.600979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"60'68","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.623821+0000","last_change":"2024-09-18T10:31:44.624499+0000","last_active":"2024-09-18T10:31:44.623821+0000","last_peered":"2024-09-18T10:31:44.623821+0000","last_clean":"2024-09-18T10:31:44.623821+0000","last_became_active":"2024-09-18T10:31:19.259917+0000","last_became_peered":"2024-09-18T10:31:19.259917+0000","last_unstale":"2024-09-18T10:31:44.623821+0000","last_undegraded":"2024-09-18T10:31:44.623821+0000","last_fullsized":"2024-09-18T10:31:44.623821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.414788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026851085,"stat_sum":{"num_bytes":5668864,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":11523,"num_write":51,"num_write_kb":6928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600722+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:44.600722+0000","last_peered":"2024-09-18T10:31:44.600722+0000","last_clean":"2024-09-18T10:31:44.600722+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:44.600722+0000","last_undegraded":"2024-09-18T10:31:44.600722+0000","last_fullsized":"2024-09-18T10:31:44.600722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"49'50","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.604146+0000","last_change":"2024-09-18T10:31:44.604946+0000","last_active":"2024-09-18T10:31:44.604146+0000","last_peered":"2024-09-18T10:31:44.604146+0000","last_clean":"2024-09-18T10:31:44.604146+0000","last_became_active":"2024-09-18T10:31:19.653910+0000","last_became_peered":"2024-09-18T10:31:19.653910+0000","last_unstale":"2024-09-18T10:31:44.604146+0000","last_undegraded":"2024-09-18T10:31:44.604146+0000","last_fullsized":"2024-09-18T10:31:44.604146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.757231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011289259999999999,"stat_sum":{"num_bytes":5537792,"num_objects":8,"num_object_clones":2,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":7876,"num_write":64,"num_write_kb":5408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600701+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:44.600701+0000","last_peered":"2024-09-18T10:31:44.600701+0000","last_clean":"2024-09-18T10:31:44.600701+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:44.600701+0000","last_undegraded":"2024-09-18T10:31:44.600701+0000","last_fullsized":"2024-09-18T10:31:44.600701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":59097088,"num_objects":81,"num_object_clones":36,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":6,"num_read":231,"num_read_kb":50390,"num_write":434,"num_write_kb":67216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105902080,"data_stored":135806976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306112,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065728,"statfs":{"total":96636764160,"available":96323305472,"internally_reserved":0,"allocated":8962048,"data_stored":11010756,"data_compressed":125137,"data_compressed_allocated":192512,"data_compressed_original":831488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":14,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308300,"kb_used_data":10944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94063540,"statfs":{"total":96636764160,"available":96321064960,"internally_reserved":0,"allocated":11206656,"data_stored":14655652,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304776,"kb_used_data":7412,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067064,"statfs":{"total":96636764160,"available":96324673536,"internally_reserved":0,"allocated":7589888,"data_stored":10066098,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313228,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305444,"kb_used_data":8080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066396,"statfs":{"total":96636764160,"available":96323989504,"internally_reserved":0,"allocated":8273920,"data_stored":9967775,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,5,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":21,"seq":90194313229,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301320,"kb_used_data":3956,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070520,"statfs":{"total":96636764160,"available":96328212480,"internally_reserved":0,"allocated":4050944,"data_stored":4364447,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313229,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":9920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":10158080,"data_stored":11724959,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306412,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065428,"statfs":{"total":96636764160,"available":96322998272,"internally_reserved":0,"allocated":9273344,"data_stored":10891428,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":3,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306016,"kb_used_data":8652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065824,"statfs":{"total":96636764160,"available":96323403776,"internally_reserved":0,"allocated":8859648,"data_stored":11094175,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4528,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4636672,"data_stored":6594724,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305448,"kb_used_data":8092,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066392,"statfs":{"total":96636764160,"available":96323985408,"internally_reserved":0,"allocated":8286208,"data_stored":10291903,"data_compressed":122167,"data_compressed_allocated":188416,"data_compressed_original":823296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":7,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304500,"kb_used_data":7136,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067340,"statfs":{"total":96636764160,"available":96324956160,"internally_reserved":0,"allocated":7307264,"data_stored":9062559,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":8,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300956,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070884,"statfs":{"total":96636764160,"available":96328585216,"internally_reserved":0,"allocated":3678208,"data_stored":4933791,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":9,"up_from":22,"seq":94489280523,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301816,"kb_used_data":4452,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070024,"statfs":{"total":96636764160,"available":96327704576,"internally_reserved":0,"allocated":4558848,"data_stored":5208223,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":10,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304240,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067600,"statfs":{"total":96636764160,"available":96325222400,"internally_reserved":0,"allocated":7041024,"data_stored":8116383,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":11,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304340,"kb_used_data":6976,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067500,"statfs":{"total":96636764160,"available":96325120000,"internally_reserved":0,"allocated":7143424,"data_stored":8358047,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":12,"up_from":22,"seq":94489280524,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302144,"kb_used_data":4780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94069696,"statfs":{"total":96636764160,"available":96327368704,"internally_reserved":0,"allocated":4894720,"data_stored":6391986,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7606272,"data_stored":9523200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8593408,"data_stored":10436608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192000,"data_stored":10649600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9490432,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3956736,"data_stored":6139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":9945088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6639616,"data_stored":8617984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":4497408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":5398528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":6373376,"data_stored":7671808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6475776,"data_stored":7921664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4222976,"data_stored":5947392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6918144,"data_stored":9629696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":14200832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":8228864,"data_stored":10027008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:46.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:47.007 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:47.006+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:47.015 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:47.016 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:47.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:47.108 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:47.107+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:47.168 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:47.169 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:47.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:47.210 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:47.208+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:47.237 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:47.249 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-18T10:31:46.620074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":59687475,"num_objects":85,"num_object_clones":36,"num_object_copies":575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":6,"num_read":317,"num_read_kb":50463,"num_write":581,"num_write_kb":69890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":4870992,"kb_used_data":113204,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505078448,"statfs":{"total":1546188226560,"available":1541200330752,"internally_reserved":0,"allocated":115920896,"data_stored":142732906,"data_compressed":1827602,"data_compressed_allocated":2572288,"data_compressed_original":6037504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3276800,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000740"},"pg_stats":[{"pgid":"3.f","version":"60'64","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.629734+0000","last_change":"2024-09-18T10:31:44.629734+0000","last_active":"2024-09-18T10:31:44.629734+0000","last_peered":"2024-09-18T10:31:44.629734+0000","last_clean":"2024-09-18T10:31:44.629734+0000","last_became_active":"2024-09-18T10:31:19.653467+0000","last_became_peered":"2024-09-18T10:31:19.653467+0000","last_unstale":"2024-09-18T10:31:44.629734+0000","last_undegraded":"2024-09-18T10:31:44.629734+0000","last_fullsized":"2024-09-18T10:31:44.629734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.811199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028072541999999999,"stat_sum":{"num_bytes":7618560,"num_objects":10,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":21,"num_read_kb":5099,"num_write":49,"num_write_kb":7440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.e","version":"44'11","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.595333+0000","last_change":"2024-09-18T10:31:44.595333+0000","last_active":"2024-09-18T10:31:44.595333+0000","last_peered":"2024-09-18T10:31:44.595333+0000","last_clean":"2024-09-18T10:31:44.595333+0000","last_became_active":"2024-09-18T10:31:19.655410+0000","last_became_peered":"2024-09-18T10:31:19.655410+0000","last_unstale":"2024-09-18T10:31:44.595333+0000","last_undegraded":"2024-09-18T10:31:44.595333+0000","last_fullsized":"2024-09-18T10:31:44.595333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.418469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047950400000000001,"stat_sum":{"num_bytes":983040,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2884,"num_write":7,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.d","version":"61'12","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-18T10:31:45.600777+0000","last_change":"2024-09-18T10:31:44.611488+0000","last_active":"2024-09-18T10:31:45.600777+0000","last_peered":"2024-09-18T10:31:45.600777+0000","last_clean":"2024-09-18T10:31:45.600777+0000","last_became_active":"2024-09-18T10:31:19.658019+0000","last_became_peered":"2024-09-18T10:31:19.658019+0000","last_unstale":"2024-09-18T10:31:45.600777+0000","last_undegraded":"2024-09-18T10:31:45.600777+0000","last_fullsized":"2024-09-18T10:31:45.600777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.132541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845533,"stat_sum":{"num_bytes":32768,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":29,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.c","version":"60'45","reported_seq":136,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.612240+0000","last_change":"2024-09-18T10:31:44.612240+0000","last_active":"2024-09-18T10:31:44.612240+0000","last_peered":"2024-09-18T10:31:44.612240+0000","last_clean":"2024-09-18T10:31:44.612240+0000","last_became_active":"2024-09-18T10:31:19.654704+0000","last_became_peered":"2024-09-18T10:31:19.654704+0000","last_unstale":"2024-09-18T10:31:44.612240+0000","last_undegraded":"2024-09-18T10:31:44.612240+0000","last_fullsized":"2024-09-18T10:31:44.612240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:40.031783+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.015098957,"stat_sum":{"num_bytes":5652480,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":18,"num_read_kb":4041,"num_write":23,"num_write_kb":5520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.b","version":"60'78","reported_seq":167,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.623818+0000","last_change":"2024-09-18T10:31:44.624967+0000","last_active":"2024-09-18T10:31:44.623818+0000","last_peered":"2024-09-18T10:31:44.623818+0000","last_clean":"2024-09-18T10:31:44.623818+0000","last_became_active":"2024-09-18T10:31:19.659120+0000","last_became_peered":"2024-09-18T10:31:19.659120+0000","last_unstale":"2024-09-18T10:31:44.623818+0000","last_undegraded":"2024-09-18T10:31:44.623818+0000","last_fullsized":"2024-09-18T10:31:44.623818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.157665+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.027359209999999998,"stat_sum":{"num_bytes":9715712,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":22,"num_read_kb":2172,"num_write":36,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.a","version":"60'35","reported_seq":125,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.607280+0000","last_change":"2024-09-18T10:31:44.607280+0000","last_active":"2024-09-18T10:31:44.607280+0000","last_peered":"2024-09-18T10:31:44.607280+0000","last_clean":"2024-09-18T10:31:44.607280+0000","last_became_active":"2024-09-18T10:31:19.656939+0000","last_became_peered":"2024-09-18T10:31:19.656939+0000","last_unstale":"2024-09-18T10:31:44.607280+0000","last_undegraded":"2024-09-18T10:31:44.607280+0000","last_fullsized":"2024-09-18T10:31:44.607280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.835368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075513009999999998,"stat_sum":{"num_bytes":2441216,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":1685,"num_write":52,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.9","version":"36'3","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.602777+0000","last_change":"2024-09-18T10:31:44.602777+0000","last_active":"2024-09-18T10:31:44.602777+0000","last_peered":"2024-09-18T10:31:44.602777+0000","last_clean":"2024-09-18T10:31:44.602777+0000","last_became_active":"2024-09-18T10:31:19.656490+0000","last_became_peered":"2024-09-18T10:31:19.656490+0000","last_unstale":"2024-09-18T10:31:44.602777+0000","last_undegraded":"2024-09-18T10:31:44.602777+0000","last_fullsized":"2024-09-18T10:31:44.602777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.159673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001465493,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.8","version":"44'9","reported_seq":99,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.594748+0000","last_change":"2024-09-18T10:31:44.594748+0000","last_active":"2024-09-18T10:31:44.594748+0000","last_peered":"2024-09-18T10:31:44.594748+0000","last_clean":"2024-09-18T10:31:44.594748+0000","last_became_active":"2024-09-18T10:31:19.656901+0000","last_became_peered":"2024-09-18T10:31:19.656901+0000","last_unstale":"2024-09-18T10:31:44.594748+0000","last_undegraded":"2024-09-18T10:31:44.594748+0000","last_fullsized":"2024-09-18T10:31:44.594748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:24.257154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407300000000001,"stat_sum":{"num_bytes":1343488,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":8,"num_read_kb":1587,"num_write":6,"num_write_kb":1312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.594411+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:44.594411+0000","last_peered":"2024-09-18T10:31:44.594411+0000","last_clean":"2024-09-18T10:31:44.594411+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:44.594411+0000","last_undegraded":"2024-09-18T10:31:44.594411+0000","last_fullsized":"2024-09-18T10:31:44.594411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600837+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:44.600837+0000","last_peered":"2024-09-18T10:31:44.600837+0000","last_clean":"2024-09-18T10:31:44.600837+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:44.600837+0000","last_undegraded":"2024-09-18T10:31:44.600837+0000","last_fullsized":"2024-09-18T10:31:44.600837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"44'10","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.601241+0000","last_change":"2024-09-18T10:31:44.601241+0000","last_active":"2024-09-18T10:31:44.601241+0000","last_peered":"2024-09-18T10:31:44.601241+0000","last_clean":"2024-09-18T10:31:44.601241+0000","last_became_active":"2024-09-18T10:31:19.656832+0000","last_became_peered":"2024-09-18T10:31:19.656832+0000","last_unstale":"2024-09-18T10:31:44.601241+0000","last_undegraded":"2024-09-18T10:31:44.601241+0000","last_fullsized":"2024-09-18T10:31:44.601241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:45.003864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051836099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.604467+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:44.604467+0000","last_peered":"2024-09-18T10:31:44.604467+0000","last_clean":"2024-09-18T10:31:44.604467+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:44.604467+0000","last_undegraded":"2024-09-18T10:31:44.604467+0000","last_fullsized":"2024-09-18T10:31:44.604467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"60'36","reported_seq":138,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.608281+0000","last_change":"2024-09-18T10:31:44.602234+0000","last_active":"2024-09-18T10:31:44.608281+0000","last_peered":"2024-09-18T10:31:44.608281+0000","last_clean":"2024-09-18T10:31:44.608281+0000","last_became_active":"2024-09-18T10:31:19.657050+0000","last_became_peered":"2024-09-18T10:31:19.657050+0000","last_unstale":"2024-09-18T10:31:44.608281+0000","last_undegraded":"2024-09-18T10:31:44.608281+0000","last_fullsized":"2024-09-18T10:31:44.608281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.836363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046776320000000001,"stat_sum":{"num_bytes":5275648,"num_objects":8,"num_object_clones":3,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":26,"num_read_kb":7114,"num_write":22,"num_write_kb":5536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600660+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:44.600660+0000","last_peered":"2024-09-18T10:31:44.600660+0000","last_clean":"2024-09-18T10:31:44.600660+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:44.600660+0000","last_undegraded":"2024-09-18T10:31:44.600660+0000","last_fullsized":"2024-09-18T10:31:44.600660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"60'64","reported_seq":151,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.622870+0000","last_change":"2024-09-18T10:31:44.622870+0000","last_active":"2024-09-18T10:31:44.622870+0000","last_peered":"2024-09-18T10:31:44.622870+0000","last_clean":"2024-09-18T10:31:44.622870+0000","last_became_active":"2024-09-18T10:31:19.653500+0000","last_became_peered":"2024-09-18T10:31:19.653500+0000","last_unstale":"2024-09-18T10:31:44.622870+0000","last_undegraded":"2024-09-18T10:31:44.622870+0000","last_fullsized":"2024-09-18T10:31:44.622870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.537620+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.021388885999999999,"stat_sum":{"num_bytes":9453568,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":34,"num_write_kb":10672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.599858+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:44.599858+0000","last_peered":"2024-09-18T10:31:44.599858+0000","last_clean":"2024-09-18T10:31:44.599858+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:44.599858+0000","last_undegraded":"2024-09-18T10:31:44.599858+0000","last_fullsized":"2024-09-18T10:31:44.599858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.609696+0000","last_change":"2024-09-18T10:31:44.609696+0000","last_active":"2024-09-18T10:31:44.609696+0000","last_peered":"2024-09-18T10:31:44.609696+0000","last_clean":"2024-09-18T10:31:44.609696+0000","last_became_active":"2024-09-18T10:31:19.653308+0000","last_became_peered":"2024-09-18T10:31:19.653308+0000","last_unstale":"2024-09-18T10:31:44.609696+0000","last_undegraded":"2024-09-18T10:31:44.609696+0000","last_fullsized":"2024-09-18T10:31:44.609696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.003091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020009110000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.5","version":"60'32","reported_seq":120,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.606846+0000","last_change":"2024-09-18T10:31:44.606846+0000","last_active":"2024-09-18T10:31:44.606846+0000","last_peered":"2024-09-18T10:31:44.606846+0000","last_clean":"2024-09-18T10:31:44.606846+0000","last_became_active":"2024-09-18T10:31:19.654834+0000","last_became_peered":"2024-09-18T10:31:19.654834+0000","last_unstale":"2024-09-18T10:31:44.606846+0000","last_undegraded":"2024-09-18T10:31:44.606846+0000","last_fullsized":"2024-09-18T10:31:44.606846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:30.217482+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0095991150000000001,"stat_sum":{"num_bytes":540672,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":10,"num_read_kb":5,"num_write":17,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T10:31:43.594650+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:43.594650+0000","last_peered":"2024-09-18T10:31:43.594650+0000","last_clean":"2024-09-18T10:31:43.594650+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:43.594650+0000","last_undegraded":"2024-09-18T10:31:43.594650+0000","last_fullsized":"2024-09-18T10:31:43.594650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"60'48","reported_seq":138,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.617537+0000","last_change":"2024-09-18T10:31:44.617537+0000","last_active":"2024-09-18T10:31:44.617537+0000","last_peered":"2024-09-18T10:31:44.617537+0000","last_clean":"2024-09-18T10:31:44.617537+0000","last_became_active":"2024-09-18T10:31:19.653632+0000","last_became_peered":"2024-09-18T10:31:19.653632+0000","last_unstale":"2024-09-18T10:31:44.617537+0000","last_undegraded":"2024-09-18T10:31:44.617537+0000","last_fullsized":"2024-09-18T10:31:44.617537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:42.743288+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.017228988000000001,"stat_sum":{"num_bytes":4833280,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":15,"num_read_kb":6391,"num_write":38,"num_write_kb":4720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600979+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:44.600979+0000","last_peered":"2024-09-18T10:31:44.600979+0000","last_clean":"2024-09-18T10:31:44.600979+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:44.600979+0000","last_undegraded":"2024-09-18T10:31:44.600979+0000","last_fullsized":"2024-09-18T10:31:44.600979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"60'68","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.623821+0000","last_change":"2024-09-18T10:31:44.624499+0000","last_active":"2024-09-18T10:31:44.623821+0000","last_peered":"2024-09-18T10:31:44.623821+0000","last_clean":"2024-09-18T10:31:44.623821+0000","last_became_active":"2024-09-18T10:31:19.259917+0000","last_became_peered":"2024-09-18T10:31:19.259917+0000","last_unstale":"2024-09-18T10:31:44.623821+0000","last_undegraded":"2024-09-18T10:31:44.623821+0000","last_fullsized":"2024-09-18T10:31:44.623821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.414788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026851085,"stat_sum":{"num_bytes":5668864,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":11523,"num_write":51,"num_write_kb":6928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600722+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:44.600722+0000","last_peered":"2024-09-18T10:31:44.600722+0000","last_clean":"2024-09-18T10:31:44.600722+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:44.600722+0000","last_undegraded":"2024-09-18T10:31:44.600722+0000","last_fullsized":"2024-09-18T10:31:44.600722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"49'50","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.604146+0000","last_change":"2024-09-18T10:31:44.604946+0000","last_active":"2024-09-18T10:31:44.604146+0000","last_peered":"2024-09-18T10:31:44.604146+0000","last_clean":"2024-09-18T10:31:44.604146+0000","last_became_active":"2024-09-18T10:31:19.653910+0000","last_became_peered":"2024-09-18T10:31:19.653910+0000","last_unstale":"2024-09-18T10:31:44.604146+0000","last_undegraded":"2024-09-18T10:31:44.604146+0000","last_fullsized":"2024-09-18T10:31:44.604146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.757231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011289259999999999,"stat_sum":{"num_bytes":5537792,"num_objects":8,"num_object_clones":2,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":7876,"num_write":64,"num_write_kb":5408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600701+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:44.600701+0000","last_peered":"2024-09-18T10:31:44.600701+0000","last_clean":"2024-09-18T10:31:44.600701+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:44.600701+0000","last_undegraded":"2024-09-18T10:31:44.600701+0000","last_fullsized":"2024-09-18T10:31:44.600701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":59097088,"num_objects":81,"num_object_clones":36,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":6,"num_read":231,"num_read_kb":50390,"num_write":434,"num_write_kb":67216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105902080,"data_stored":135806976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306112,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065728,"statfs":{"total":96636764160,"available":96323305472,"internally_reserved":0,"allocated":8962048,"data_stored":11010756,"data_compressed":125137,"data_compressed_allocated":192512,"data_compressed_original":831488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":14,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308300,"kb_used_data":10944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94063540,"statfs":{"total":96636764160,"available":96321064960,"internally_reserved":0,"allocated":11206656,"data_stored":14655652,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304776,"kb_used_data":7412,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067064,"statfs":{"total":96636764160,"available":96324673536,"internally_reserved":0,"allocated":7589888,"data_stored":10066098,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313228,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305444,"kb_used_data":8080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066396,"statfs":{"total":96636764160,"available":96323989504,"internally_reserved":0,"allocated":8273920,"data_stored":9967775,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,5,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":21,"seq":90194313229,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301320,"kb_used_data":3956,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070520,"statfs":{"total":96636764160,"available":96328212480,"internally_reserved":0,"allocated":4050944,"data_stored":4364447,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313229,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":9920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":10158080,"data_stored":11724959,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306412,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065428,"statfs":{"total":96636764160,"available":96322998272,"internally_reserved":0,"allocated":9273344,"data_stored":10891428,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":3,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306016,"kb_used_data":8652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065824,"statfs":{"total":96636764160,"available":96323403776,"internally_reserved":0,"allocated":8859648,"data_stored":11094175,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4528,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4636672,"data_stored":6594724,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305448,"kb_used_data":8092,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066392,"statfs":{"total":96636764160,"available":96323985408,"internally_reserved":0,"allocated":8286208,"data_stored":10291903,"data_compressed":122167,"data_compressed_allocated":188416,"data_compressed_original":823296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":7,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304500,"kb_used_data":7136,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067340,"statfs":{"total":96636764160,"available":96324956160,"internally_reserved":0,"allocated":7307264,"data_stored":9062559,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":8,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300956,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070884,"statfs":{"total":96636764160,"available":96328585216,"internally_reserved":0,"allocated":3678208,"data_stored":4933791,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":9,"up_from":22,"seq":94489280523,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301816,"kb_used_data":4452,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070024,"statfs":{"total":96636764160,"available":96327704576,"internally_reserved":0,"allocated":4558848,"data_stored":5208223,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":10,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304240,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067600,"statfs":{"total":96636764160,"available":96325222400,"internally_reserved":0,"allocated":7041024,"data_stored":8116383,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":11,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304340,"kb_used_data":6976,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067500,"statfs":{"total":96636764160,"available":96325120000,"internally_reserved":0,"allocated":7143424,"data_stored":8358047,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":12,"up_from":22,"seq":94489280524,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302144,"kb_used_data":4780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94069696,"statfs":{"total":96636764160,"available":96327368704,"internally_reserved":0,"allocated":4894720,"data_stored":6391986,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7606272,"data_stored":9523200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8593408,"data_stored":10436608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192000,"data_stored":10649600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9490432,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3956736,"data_stored":6139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":9945088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6639616,"data_stored":8617984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":4497408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":5398528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":6373376,"data_stored":7671808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6475776,"data_stored":7921664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4222976,"data_stored":5947392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6918144,"data_stored":9629696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":14200832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":8228864,"data_stored":10027008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:47.252 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T10:31:47.252 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:31:47.252 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-18T10:31:47.252 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-18T10:31:47.282 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:47.282 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:47.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:47.310 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:47.308+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:47.411 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:47.410+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:47.486 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:47.486 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:47.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:47.512 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:47.512+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:47.600 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:47.600 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 62, 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "f10241a9-9f2d-4ca9-8e5f-6c8b84917f59", 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-18T10:30:48.790325+0000", 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-18T10:31:46.596552+0000", 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-18T10:31:00.027262+0000", 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-18T10:30:52.907993+0000", 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-18T10:31:47.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5804032, 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "nodeep-scrub", 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 6, 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-18T10:31:47.605 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 3, 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 16, 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "jewel", 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "quincy", 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-18T10:31:00.658279+0000", 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-18T10:31:47.606 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-18T10:31:47.607 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "25", 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-18T10:31:47.608 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-18T10:31:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-18T10:31:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-18T10:31:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-18T10:31:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-18T10:31:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-18T10:31:47.609 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-18T10:31:47.610 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-18T10:31:47.611 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "rbd", 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-18T10:31:03.266294+0000", 2024-09-18T10:31:47.612 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 8, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 8, 2024-09-18T10:31:47.613 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 8, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 8, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 8, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "29", 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-18T10:31:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 3, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 29, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-18T10:31:47.615 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-18T10:31:47.616 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd": {} 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "unique_pool_0", 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-18T10:31:17.263911+0000", 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 8193, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 3, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 7, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 5, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 1, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-18T10:31:47.618 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 16, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 16, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 16, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 16, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 16, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-18T10:31:47.619 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "62", 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 27, 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 62, 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-18T10:31:47.620 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "shecprofile", 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-18T10:31:47.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 16384, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-18T10:31:47.622 INFO:teuthology.orchestra.run.smithi063.stdout: "options": {}, 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "rados": {} 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c9c90e0f-90b7-4324-b194-50466925bab4", 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 21, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2024-09-18T10:31:47.624 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2024-09-18T10:31:47.625 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.626 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.627 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33484 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/33484", 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/33484", 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/33484", 2024-09-18T10:31:47.628 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/33484", 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "364707f8-7c53-4434-8eb4-bed8f4fd131d", 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.629 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.630 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.630 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 21, 2024-09-18T10:31:47.630 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 0, 2024-09-18T10:31:47.632 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.632 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.632 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6800", 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6801", 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.633 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6802", 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6803", 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.634 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6806", 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6807", 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6804", 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6805", 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32741 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.71:6801/32741", 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.71:6803/32741", 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.71:6807/32741", 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.71:6805/32741", 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "a1f8ec72-eb1a-4808-beba-7a6e6e840e5e", 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.637 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 0, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6808", 2024-09-18T10:31:47.638 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6810", 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6813", 2024-09-18T10:31:47.639 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6816", 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.640 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6825", 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6828", 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.641 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6819", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6822", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33036 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.100:6810/33036", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.100:6816/33036", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.100:6828/33036", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.100:6822/33036", 2024-09-18T10:31:47.642 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "7528ada4-39f9-44a0-b312-d9774c1c38b0", 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.643 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6811", 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6813", 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6814", 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6816", 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6822", 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6824", 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.647 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6818", 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6820", 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33050 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.648 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.160:6813/33050", 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.160:6816/33050", 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.160:6824/33050", 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.160:6820/33050", 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "7e30062e-3d74-4374-abe1-708614474f78", 2024-09-18T10:31:47.649 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 21, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33485 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/33485", 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/33485", 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6815/33485", 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/33485", 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "cfbff4f8-6118-4080-8c53-a9191a6e2e2f", 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.656 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6809", 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6811", 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6813", 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6815", 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.658 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6821", 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6823", 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6817", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6819", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32742 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.71:6811/32742", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.71:6815/32742", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.71:6823/32742", 2024-09-18T10:31:47.660 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.71:6819/32742", 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "2dc036cf-74e5-4e91-9f75-9f122e112a49", 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.661 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6800", 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6801", 2024-09-18T10:31:47.662 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6802", 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.663 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6803", 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6806", 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.664 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6807", 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6804", 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.665 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6805", 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33037 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.100:6801/33037", 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.100:6803/33037", 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.100:6807/33037", 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.100:6805/33037", 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.666 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "72893ca2-e288-4271-9fe0-c3df5c26d0c7", 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6802", 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6803", 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.668 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6804", 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6805", 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.669 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6808", 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6809", 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.670 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6806", 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6807", 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33051 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.160:6803/33051", 2024-09-18T10:31:47.671 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.160:6805/33051", 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.160:6809/33051", 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.160:6807/33051", 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 8, 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "c5a0c4b5-4450-43bb-9571-509d1baa2db6", 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.672 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33488 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6817/33488", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/33488", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6823/33488", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/33488", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 9, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "bdca945d-8cfe-4bea-a7a6-10116f45f750", 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 26, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.678 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6808", 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6810", 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6812", 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6814", 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6820", 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6822", 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.681 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6816", 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6818", 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32743 2024-09-18T10:31:47.682 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.71:6810/32743", 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.71:6814/32743", 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.71:6822/32743", 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.71:6818/32743", 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 10, 2024-09-18T10:31:47.683 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb", 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6811", 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6814", 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6817", 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6820", 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6829", 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6831", 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6823", 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6826", 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33038 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.100:6814/33038", 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.100:6820/33038", 2024-09-18T10:31:47.688 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.100:6831/33038", 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.100:6826/33038", 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 11, 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "74271b10-6952-4938-9916-e89bc18a872f", 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.689 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6826", 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6827", 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6828", 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6829", 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6832", 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6833", 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6830", 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6831", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33052 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.160:6827/33052", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.160:6829/33052", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.160:6833/33052", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.160:6831/33052", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.694 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 12, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "9a3a5069-5cd1-450a-813b-ddd96237db5c", 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 0, 2024-09-18T10:31:47.695 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.696 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33486 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.699 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6825/33486", 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/33486", 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/33486", 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/33486", 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 13, 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "47a76a68-b71d-4012-b2f7-3e40e8583a46", 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6824", 2024-09-18T10:31:47.701 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6825", 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6826", 2024-09-18T10:31:47.702 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6827", 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6830", 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6831", 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6828", 2024-09-18T10:31:47.704 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.71:6829", 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 32744 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.71:6825/32744", 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.71:6827/32744", 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.71:6831/32744", 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.71:6829/32744", 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.705 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 14, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5297107d-2ab9-4107-8461-0aa59c98d685", 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.706 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 33, 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6809", 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6812", 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.707 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6815", 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6818", 2024-09-18T10:31:47.708 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6827", 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6830", 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.710 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6821", 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.100:6824", 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33039 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.100:6812/33039", 2024-09-18T10:31:47.711 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.100:6818/33039", 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.100:6830/33039", 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.100:6824/33039", 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 15, 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "1bcc1d74-88c8-4dc5-8262-ead5b4a20377", 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-18T10:31:47.712 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 22, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 0, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6810", 2024-09-18T10:31:47.713 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6812", 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6815", 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6817", 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6823", 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6825", 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6819", 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.160:6821", 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 33053 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.160:6812/33053", 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.160:6817/33053", 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.160:6825/33053", 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.160:6821/33053", 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-18T10:31:47.717 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:57.990432+0000", 2024-09-18T10:31:47.718 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:57.941659+0000", 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-18T10:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.111884+0000", 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.720 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.061397+0000", 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:57.963684+0000", 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.033416+0000", 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.722 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.049603+0000", 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.723 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.068434+0000", 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 8, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.011033+0000", 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.724 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 9, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.090509+0000", 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 10, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.725 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.057952+0000", 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 11, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.040059+0000", 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 12, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.024718+0000", 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 13, 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.727 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.029645+0000", 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 14, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.728 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.093324+0000", 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 15, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540138320759226367, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-18T10:30:58.008295+0000", 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:47.729 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [], 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: "shecprofile": { 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "c": "2", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-device-class": "", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-root": "default", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "4", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "3", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "shecprofile", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "shec", 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "multiple" 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [ 2024-09-18T10:31:47.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "snaps": [ 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 11, 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 13, 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 15, 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1 2024-09-18T10:31:47.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 17, 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 19, 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 22, 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 2 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.733 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [ 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "snaps": [ 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "begin": 23, 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "length": 1 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-18T10:31:47.734 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:47.735 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:47.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:47.740 INFO:tasks.thrashosds.thrasher:j is {'epoch': 62, 'fsid': 'f10241a9-9f2d-4ca9-8e5f-6c8b84917f59', 'created': '2024-09-18T10:30:48.790325+0000', 'modified': '2024-09-18T10:31:46.596552+0000', 'last_up_change': '2024-09-18T10:31:00.027262+0000', 'last_in_change': '2024-09-18T10:30:52.907993+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 16, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'quincy', 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T10:31:00.658279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T10:31:03.266294+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 29, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-18T10:31:17.263911+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 3, 'size': 7, 'min_size': 5, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 62, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'shecprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 16384, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'c9c90e0f-90b7-4324-b194-50466925bab4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6800', 'nonce': 33484}, {'type': 'v1', 'addr': '172.21.15.63:6801', 'nonce': 33484}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6802', 'nonce': 33484}, {'type': 'v1', 'addr': '172.21.15.63:6803', 'nonce': 33484}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6806', 'nonce': 33484}, {'type': 'v1', 'addr': '172.21.15.63:6807', 'nonce': 33484}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6804', 'nonce': 33484}, {'type': 'v1', 'addr': '172.21.15.63:6805', 'nonce': 33484}]}, 'public_addr': '172.21.15.63:6801/33484', 'cluster_addr': '172.21.15.63:6803/33484', 'heartbeat_back_addr': '172.21.15.63:6807/33484', 'heartbeat_front_addr': '172.21.15.63:6805/33484', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '364707f8-7c53-4434-8eb4-bed8f4fd131d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 32741}, {'type': 'v1', 'addr': '172.21.15.71:6801', 'nonce': 32741}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 32741}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 32741}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6806', 'nonce': 32741}, {'type': 'v1', 'addr': '172.21.15.71:6807', 'nonce': 32741}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 32741}, {'type': 'v1', 'addr': '172.21.15.71:6805', 'nonce': 32741}]}, 'public_addr': '172.21.15.71:6801/32741', 'cluster_addr': '172.21.15.71:6803/32741', 'heartbeat_back_addr': '172.21.15.71:6807/32741', 'heartbeat_front_addr': '172.21.15.71:6805/32741', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a1f8ec72-eb1a-4808-beba-7a6e6e840e5e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6808', 'nonce': 33036}, {'type': 'v1', 'addr': '172.21.15.100:6810', 'nonce': 33036}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6813', 'nonce': 33036}, {'type': 'v1', 'addr': '172.21.15.100:6816', 'nonce': 33036}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6825', 'nonce': 33036}, {'type': 'v1', 'addr': '172.21.15.100:6828', 'nonce': 33036}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6819', 'nonce': 33036}, {'type': 'v1', 'addr': '172.21.15.100:6822', 'nonce': 33036}]}, 'public_addr': '172.21.15.100:6810/33036', 'cluster_addr': '172.21.15.100:6816/33036', 'heartbeat_back_addr': '172.21.15.100:6828/33036', 'heartbeat_front_addr': '172.21.15.100:6822/33036', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7528ada4-39f9-44a0-b312-d9774c1c38b0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6811', 'nonce': 33050}, {'type': 'v1', 'addr': '172.21.15.160:6813', 'nonce': 33050}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6814', 'nonce': 33050}, {'type': 'v1', 'addr': '172.21.15.160:6816', 'nonce': 33050}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6822', 'nonce': 33050}, {'type': 'v1', 'addr': '172.21.15.160:6824', 'nonce': 33050}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6818', 'nonce': 33050}, {'type': 'v1', 'addr': '172.21.15.160:6820', 'nonce': 33050}]}, 'public_addr': '172.21.15.160:6813/33050', 'cluster_addr': '172.21.15.160:6816/33050', 'heartbeat_back_addr': '172.21.15.160:6824/33050', 'heartbeat_front_addr': '172.21.15.160:6820/33050', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7e30062e-3d74-4374-abe1-708614474f78', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6808', 'nonce': 33485}, {'type': 'v1', 'addr': '172.21.15.63:6809', 'nonce': 33485}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6810', 'nonce': 33485}, {'type': 'v1', 'addr': '172.21.15.63:6811', 'nonce': 33485}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6814', 'nonce': 33485}, {'type': 'v1', 'addr': '172.21.15.63:6815', 'nonce': 33485}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6812', 'nonce': 33485}, {'type': 'v1', 'addr': '172.21.15.63:6813', 'nonce': 33485}]}, 'public_addr': '172.21.15.63:6809/33485', 'cluster_addr': '172.21.15.63:6811/33485', 'heartbeat_back_addr': '172.21.15.63:6815/33485', 'heartbeat_front_addr': '172.21.15.63:6813/33485', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'cfbff4f8-6118-4080-8c53-a9191a6e2e2f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 32742}, {'type': 'v1', 'addr': '172.21.15.71:6811', 'nonce': 32742}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6813', 'nonce': 32742}, {'type': 'v1', 'addr': '172.21.15.71:6815', 'nonce': 32742}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6821', 'nonce': 32742}, {'type': 'v1', 'addr': '172.21.15.71:6823', 'nonce': 32742}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6817', 'nonce': 32742}, {'type': 'v1', 'addr': '172.21.15.71:6819', 'nonce': 32742}]}, 'public_addr': '172.21.15.71:6811/32742', 'cluster_addr': '172.21.15.71:6815/32742', 'heartbeat_back_addr': '172.21.15.71:6823/32742', 'heartbeat_front_addr': '172.21.15.71:6819/32742', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2dc036cf-74e5-4e91-9f75-9f122e112a49', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6800', 'nonce': 33037}, {'type': 'v1', 'addr': '172.21.15.100:6801', 'nonce': 33037}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6802', 'nonce': 33037}, {'type': 'v1', 'addr': '172.21.15.100:6803', 'nonce': 33037}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6806', 'nonce': 33037}, {'type': 'v1', 'addr': '172.21.15.100:6807', 'nonce': 33037}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6804', 'nonce': 33037}, {'type': 'v1', 'addr': '172.21.15.100:6805', 'nonce': 33037}]}, 'public_addr': '172.21.15.100:6801/33037', 'cluster_addr': '172.21.15.100:6803/33037', 'heartbeat_back_addr': '172.21.15.100:6807/33037', 'heartbeat_front_addr': '172.21.15.100:6805/33037', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '72893ca2-e288-4271-9fe0-c3df5c26d0c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6802', 'nonce': 33051}, {'type': 'v1', 'addr': '172.21.15.160:6803', 'nonce': 33051}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6804', 'nonce': 33051}, {'type': 'v1', 'addr': '172.21.15.160:6805', 'nonce': 33051}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6808', 'nonce': 33051}, {'type': 'v1', 'addr': '172.21.15.160:6809', 'nonce': 33051}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6806', 'nonce': 33051}, {'type': 'v1', 'addr': '172.21.15.160:6807', 'nonce': 33051}]}, 'public_addr': '172.21.15.160:6803/33051', 'cluster_addr': '172.21.15.160:6805/33051', 'heartbeat_back_addr': '172.21.15.160:6809/33051', 'heartbeat_front_addr': '172.21.15.160:6807/33051', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': 'c5a0c4b5-4450-43bb-9571-509d1baa2db6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6816', 'nonce': 33488}, {'type': 'v1', 'addr': '172.21.15.63:6817', 'nonce': 33488}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6818', 'nonce': 33488}, {'type': 'v1', 'addr': '172.21.15.63:6819', 'nonce': 33488}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6822', 'nonce': 33488}, {'type': 'v1', 'addr': '172.21.15.63:6823', 'nonce': 33488}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6820', 'nonce': 33488}, {'type': 'v1', 'addr': '172.21.15.63:6821', 'nonce': 33488}]}, 'public_addr': '172.21.15.63:6817/33488', 'cluster_addr': '172.21.15.63:6819/33488', 'heartbeat_back_addr': '172.21.15.63:6823/33488', 'heartbeat_front_addr': '172.21.15.63:6821/33488', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': 'bdca945d-8cfe-4bea-a7a6-10116f45f750', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 26, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6808', 'nonce': 32743}, {'type': 'v1', 'addr': '172.21.15.71:6810', 'nonce': 32743}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6812', 'nonce': 32743}, {'type': 'v1', 'addr': '172.21.15.71:6814', 'nonce': 32743}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6820', 'nonce': 32743}, {'type': 'v1', 'addr': '172.21.15.71:6822', 'nonce': 32743}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6816', 'nonce': 32743}, {'type': 'v1', 'addr': '172.21.15.71:6818', 'nonce': 32743}]}, 'public_addr': '172.21.15.71:6810/32743', 'cluster_addr': '172.21.15.71:6814/32743', 'heartbeat_back_addr': '172.21.15.71:6822/32743', 'heartbeat_front_addr': '172.21.15.71:6818/32743', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': '2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6811', 'nonce': 33038}, {'type': 'v1', 'addr': '172.21.15.100:6814', 'nonce': 33038}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6817', 'nonce': 33038}, {'type': 'v1', 'addr': '172.21.15.100:6820', 'nonce': 33038}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6829', 'nonce': 33038}, {'type': 'v1', 'addr': '172.21.15.100:6831', 'nonce': 33038}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6823', 'nonce': 33038}, {'type': 'v1', 'addr': '172.21.15.100:6826', 'nonce': 33038}]}, 'public_addr': '172.21.15.100:6814/33038', 'cluster_addr': '172.21.15.100:6820/33038', 'heartbeat_back_addr': '172.21.15.100:6831/33038', 'heartbeat_front_addr': '172.21.15.100:6826/33038', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': '74271b10-6952-4938-9916-e89bc18a872f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6826', 'nonce': 33052}, {'type': 'v1', 'addr': '172.21.15.160:6827', 'nonce': 33052}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6828', 'nonce': 33052}, {'type': 'v1', 'addr': '172.21.15.160:6829', 'nonce': 33052}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 33052}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 33052}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6830', 'nonce': 33052}, {'type': 'v1', 'addr': '172.21.15.160:6831', 'nonce': 33052}]}, 'public_addr': '172.21.15.160:6827/33052', 'cluster_addr': '172.21.15.160:6829/33052', 'heartbeat_back_addr': '172.21.15.160:6833/33052', 'heartbeat_front_addr': '172.21.15.160:6831/33052', 'state': ['exists', 'up']}, {'osd': 12, 'uuid': '9a3a5069-5cd1-450a-813b-ddd96237db5c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6824', 'nonce': 33486}, {'type': 'v1', 'addr': '172.21.15.63:6825', 'nonce': 33486}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6826', 'nonce': 33486}, {'type': 'v1', 'addr': '172.21.15.63:6827', 'nonce': 33486}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6830', 'nonce': 33486}, {'type': 'v1', 'addr': '172.21.15.63:6831', 'nonce': 33486}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6828', 'nonce': 33486}, {'type': 'v1', 'addr': '172.21.15.63:6829', 'nonce': 33486}]}, 'public_addr': '172.21.15.63:6825/33486', 'cluster_addr': '172.21.15.63:6827/33486', 'heartbeat_back_addr': '172.21.15.63:6831/33486', 'heartbeat_front_addr': '172.21.15.63:6829/33486', 'state': ['exists', 'up']}, {'osd': 13, 'uuid': '47a76a68-b71d-4012-b2f7-3e40e8583a46', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6824', 'nonce': 32744}, {'type': 'v1', 'addr': '172.21.15.71:6825', 'nonce': 32744}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6826', 'nonce': 32744}, {'type': 'v1', 'addr': '172.21.15.71:6827', 'nonce': 32744}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6830', 'nonce': 32744}, {'type': 'v1', 'addr': '172.21.15.71:6831', 'nonce': 32744}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6828', 'nonce': 32744}, {'type': 'v1', 'addr': '172.21.15.71:6829', 'nonce': 32744}]}, 'public_addr': '172.21.15.71:6825/32744', 'cluster_addr': '172.21.15.71:6827/32744', 'heartbeat_back_addr': '172.21.15.71:6831/32744', 'heartbeat_front_addr': '172.21.15.71:6829/32744', 'state': ['exists', 'up']}, {'osd': 14, 'uuid': '5297107d-2ab9-4107-8461-0aa59c98d685', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6809', 'nonce': 33039}, {'type': 'v1', 'addr': '172.21.15.100:6812', 'nonce': 33039}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6815', 'nonce': 33039}, {'type': 'v1', 'addr': '172.21.15.100:6818', 'nonce': 33039}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6827', 'nonce': 33039}, {'type': 'v1', 'addr': '172.21.15.100:6830', 'nonce': 33039}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6821', 'nonce': 33039}, {'type': 'v1', 'addr': '172.21.15.100:6824', 'nonce': 33039}]}, 'public_addr': '172.21.15.100:6812/33039', 'cluster_addr': '172.21.15.100:6818/33039', 'heartbeat_back_addr': '172.21.15.100:6830/33039', 'heartbeat_front_addr': '172.21.15.100:6824/33039', 'state': ['exists', 'up']}, {'osd': 15, 'uuid': '1bcc1d74-88c8-4dc5-8262-ead5b4a20377', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6810', 'nonce': 33053}, {'type': 'v1', 'addr': '172.21.15.160:6812', 'nonce': 33053}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6815', 'nonce': 33053}, {'type': 'v1', 'addr': '172.21.15.160:6817', 'nonce': 33053}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6823', 'nonce': 33053}, {'type': 'v1', 'addr': '172.21.15.160:6825', 'nonce': 33053}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6819', 'nonce': 33053}, {'type': 'v1', 'addr': '172.21.15.160:6821', 'nonce': 33053}]}, 'public_addr': '172.21.15.160:6812/33053', 'cluster_addr': '172.21.15.160:6817/33053', 'heartbeat_back_addr': '172.21.15.160:6825/33053', 'heartbeat_front_addr': '172.21.15.160:6821/33053', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:57.990432+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:57.941659+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.111884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.061397+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:57.963684+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.033416+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.049603+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.068434+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.011033+0000', 'dead_epoch': 0}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.090509+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.057952+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.040059+0000', 'dead_epoch': 0}, {'osd': 12, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.024718+0000', 'dead_epoch': 0}, {'osd': 13, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.029645+0000', 'dead_epoch': 0}, {'osd': 14, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.093324+0000', 'dead_epoch': 0}, {'osd': 15, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138320759226367, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-18T10:30:58.008295+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}, 'shecprofile': {'c': '2', 'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-root': 'default', 'k': '4', 'm': '3', 'name': 'shecprofile', 'plugin': 'shec', 'technique': 'multiple'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 1}, {'begin': 13, 'length': 1}, {'begin': 15, 'length': 1}, {'begin': 17, 'length': 1}, {'begin': 19, 'length': 1}, {'begin': 22, 'length': 2}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 23, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-18T10:31:47.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:31:47.740 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:47.735+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:47.742 INFO:tasks.rados.rados.0.smithi160.stdout:196: done (5 left) 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 18 current snap is 14 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:190: finishing rollback tid 0 to smithi16036501-8 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:197: seq_num 99 ranges {0=507904,507904=606208,1114112=557056} 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:197: writing smithi16036501-18 from 0 to 507904 tid 1 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:197: writing smithi16036501-18 from 507904 to 1114112 tid 2 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:197: writing smithi16036501-18 from 1114112 to 1671168 tid 3 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 50 current snap is 14 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 2 v 12 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:198: seq_num 100 ranges {835584=524288,1359872=753664,2113536=409600} 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:198: writing smithi16036501-50 from 835584 to 1359872 tid 1 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:198: writing smithi16036501-50 from 1359872 to 2113536 tid 2 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:198: writing smithi16036501-50 from 2113536 to 2523136 tid 3 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:191: done (6 left) 2024-09-18T10:31:47.743 INFO:tasks.rados.rados.0.smithi160.stdout:199: rmattr oid 49 current snap is 14 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:199: done (6 left) 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:200: delete oid 9 current snap is 14 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:190: finishing rollback tid 1 to smithi16036501-8 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:190: finishing rollback tid 2 to smithi16036501-8 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 8 v 54 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:192: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:193: finishing write tid 1 to smithi16036501-43 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:193: finishing write tid 2 to smithi16036501-43 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:194: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:193: finishing write tid 3 to smithi16036501-43 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:193: finishing write tid 4 to smithi16036501-43 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:193: finishing write tid 5 to smithi16036501-43 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:193: finishing write tid 6 to smithi16036501-43 2024-09-18T10:31:47.744 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 43 v 60 (ObjNum 98 snap 14 seq_num 98) dirty exists 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:193: left oid 43 (ObjNum 98 snap 14 seq_num 98) 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:197: finishing write tid 1 to smithi16036501-18 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:197: finishing write tid 2 to smithi16036501-18 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:190: done (6 left) 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:192: done (5 left) 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:193: done (4 left) 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:194: done (3 left) 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:200: done (2 left) 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:201: setattr oid 4 current snap is 14 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:197: finishing write tid 3 to smithi16036501-18 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:197: finishing write tid 4 to smithi16036501-18 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:197: finishing write tid 5 to smithi16036501-18 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 18 v 39 (ObjNum 99 snap 14 seq_num 99) dirty exists 2024-09-18T10:31:47.745 INFO:tasks.rados.rados.0.smithi160.stdout:197: left oid 18 (ObjNum 99 snap 14 seq_num 99) 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: finishing write tid 1 to smithi16036501-50 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: finishing write tid 2 to smithi16036501-50 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: finishing write tid 3 to smithi16036501-50 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: finishing write tid 4 to smithi16036501-50 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: finishing write tid 5 to smithi16036501-50 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 50 v 16 (ObjNum 100 snap 14 seq_num 100) dirty exists 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: left oid 50 (ObjNum 100 snap 14 seq_num 100) 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:197: done (2 left) 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:198: done (1 left) 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:202: rmattr oid 46 current snap is 14 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:202: done (1 left) 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 9 current snap is 14 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:203: seq_num 102 ranges {0=557056,557056=638976,1196032=524288} 2024-09-18T10:31:47.746 INFO:tasks.rados.rados.0.smithi160.stdout:203: writing smithi16036501-9 from 0 to 557056 tid 1 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:203: writing smithi16036501-9 from 557056 to 1196032 tid 2 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:203: writing smithi16036501-9 from 1196032 to 1720320 tid 3 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 49 current snap is 14 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 4 v 81 (ObjNum 85 snap 10 seq_num 85) dirty exists 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:204: seq_num 103 ranges {819200=573440,1392640=786432,2179072=376832} 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:204: writing smithi16036501-49 from 819200 to 1392640 tid 1 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:204: writing smithi16036501-49 from 1392640 to 2179072 tid 2 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:204: writing smithi16036501-49 from 2179072 to 2555904 tid 3 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:201: done (2 left) 2024-09-18T10:31:47.747 INFO:tasks.rados.rados.0.smithi160.stdout:205: snap_remove snap 3 2024-09-18T10:31:47.837 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:47.836+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:47.881 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:47.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:47.938 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:47.936+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:48.032 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.033 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:48.042 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:48.040+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:48.055 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:31:48.056 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:31:48.067 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-18T10:31:47.604638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":59687475,"num_objects":85,"num_object_clones":36,"num_object_copies":575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":6,"num_read":317,"num_read_kb":50463,"num_write":581,"num_write_kb":69890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":4870992,"kb_used_data":113204,"kb_used_omap":26,"kb_used_meta":4757477,"kb_avail":1505078448,"statfs":{"total":1546188226560,"available":1541200330752,"internally_reserved":0,"allocated":115920896,"data_stored":142732906,"data_compressed":1827602,"data_compressed_allocated":2572288,"data_compressed_original":6037504,"omap_allocated":27264,"internal_metadata":4871656832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3276800,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012511"},"pg_stats":[{"pgid":"3.f","version":"60'64","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.629734+0000","last_change":"2024-09-18T10:31:44.629734+0000","last_active":"2024-09-18T10:31:44.629734+0000","last_peered":"2024-09-18T10:31:44.629734+0000","last_clean":"2024-09-18T10:31:44.629734+0000","last_became_active":"2024-09-18T10:31:19.653467+0000","last_became_peered":"2024-09-18T10:31:19.653467+0000","last_unstale":"2024-09-18T10:31:44.629734+0000","last_undegraded":"2024-09-18T10:31:44.629734+0000","last_fullsized":"2024-09-18T10:31:44.629734+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.811199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028072541999999999,"stat_sum":{"num_bytes":7618560,"num_objects":10,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":21,"num_read_kb":5099,"num_write":49,"num_write_kb":7440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.e","version":"44'11","reported_seq":105,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.595333+0000","last_change":"2024-09-18T10:31:44.595333+0000","last_active":"2024-09-18T10:31:44.595333+0000","last_peered":"2024-09-18T10:31:44.595333+0000","last_clean":"2024-09-18T10:31:44.595333+0000","last_became_active":"2024-09-18T10:31:19.655410+0000","last_became_peered":"2024-09-18T10:31:19.655410+0000","last_unstale":"2024-09-18T10:31:44.595333+0000","last_undegraded":"2024-09-18T10:31:44.595333+0000","last_fullsized":"2024-09-18T10:31:44.595333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.418469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047950400000000001,"stat_sum":{"num_bytes":983040,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2884,"num_write":7,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.d","version":"61'12","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-18T10:31:45.600777+0000","last_change":"2024-09-18T10:31:44.611488+0000","last_active":"2024-09-18T10:31:45.600777+0000","last_peered":"2024-09-18T10:31:45.600777+0000","last_clean":"2024-09-18T10:31:45.600777+0000","last_became_active":"2024-09-18T10:31:19.658019+0000","last_became_peered":"2024-09-18T10:31:19.658019+0000","last_unstale":"2024-09-18T10:31:45.600777+0000","last_undegraded":"2024-09-18T10:31:45.600777+0000","last_fullsized":"2024-09-18T10:31:45.600777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.132541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011845533,"stat_sum":{"num_bytes":32768,"num_objects":3,"num_object_clones":2,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":29,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,9,8,4],"acting":[13,1,11,15,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.c","version":"60'45","reported_seq":136,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.612240+0000","last_change":"2024-09-18T10:31:44.612240+0000","last_active":"2024-09-18T10:31:44.612240+0000","last_peered":"2024-09-18T10:31:44.612240+0000","last_clean":"2024-09-18T10:31:44.612240+0000","last_became_active":"2024-09-18T10:31:19.654704+0000","last_became_peered":"2024-09-18T10:31:19.654704+0000","last_unstale":"2024-09-18T10:31:44.612240+0000","last_undegraded":"2024-09-18T10:31:44.612240+0000","last_fullsized":"2024-09-18T10:31:44.612240+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:40.031783+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.015098957,"stat_sum":{"num_bytes":5652480,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":18,"num_read_kb":4041,"num_write":23,"num_write_kb":5520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.b","version":"60'78","reported_seq":167,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.623818+0000","last_change":"2024-09-18T10:31:44.624967+0000","last_active":"2024-09-18T10:31:44.623818+0000","last_peered":"2024-09-18T10:31:44.623818+0000","last_clean":"2024-09-18T10:31:44.623818+0000","last_became_active":"2024-09-18T10:31:19.659120+0000","last_became_peered":"2024-09-18T10:31:19.659120+0000","last_unstale":"2024-09-18T10:31:44.623818+0000","last_undegraded":"2024-09-18T10:31:44.623818+0000","last_fullsized":"2024-09-18T10:31:44.623818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.157665+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.027359209999999998,"stat_sum":{"num_bytes":9715712,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":22,"num_read_kb":2172,"num_write":36,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.a","version":"60'35","reported_seq":125,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.607280+0000","last_change":"2024-09-18T10:31:44.607280+0000","last_active":"2024-09-18T10:31:44.607280+0000","last_peered":"2024-09-18T10:31:44.607280+0000","last_clean":"2024-09-18T10:31:44.607280+0000","last_became_active":"2024-09-18T10:31:19.656939+0000","last_became_peered":"2024-09-18T10:31:19.656939+0000","last_unstale":"2024-09-18T10:31:44.607280+0000","last_undegraded":"2024-09-18T10:31:44.607280+0000","last_fullsized":"2024-09-18T10:31:44.607280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.835368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075513009999999998,"stat_sum":{"num_bytes":2441216,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":1685,"num_write":52,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.9","version":"36'3","reported_seq":89,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.602777+0000","last_change":"2024-09-18T10:31:44.602777+0000","last_active":"2024-09-18T10:31:44.602777+0000","last_peered":"2024-09-18T10:31:44.602777+0000","last_clean":"2024-09-18T10:31:44.602777+0000","last_became_active":"2024-09-18T10:31:19.656490+0000","last_became_peered":"2024-09-18T10:31:19.656490+0000","last_unstale":"2024-09-18T10:31:44.602777+0000","last_undegraded":"2024-09-18T10:31:44.602777+0000","last_fullsized":"2024-09-18T10:31:44.602777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.159673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001465493,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.8","version":"44'9","reported_seq":99,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.594748+0000","last_change":"2024-09-18T10:31:44.594748+0000","last_active":"2024-09-18T10:31:44.594748+0000","last_peered":"2024-09-18T10:31:44.594748+0000","last_clean":"2024-09-18T10:31:44.594748+0000","last_became_active":"2024-09-18T10:31:19.656901+0000","last_became_peered":"2024-09-18T10:31:19.656901+0000","last_unstale":"2024-09-18T10:31:44.594748+0000","last_undegraded":"2024-09-18T10:31:44.594748+0000","last_fullsized":"2024-09-18T10:31:44.594748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:24.257154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046407300000000001,"stat_sum":{"num_bytes":1343488,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":8,"num_read_kb":1587,"num_write":6,"num_write_kb":1312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"1.0","version":"26'112","reported_seq":180,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.594411+0000","last_change":"2024-09-18T10:31:02.824477+0000","last_active":"2024-09-18T10:31:44.594411+0000","last_peered":"2024-09-18T10:31:44.594411+0000","last_clean":"2024-09-18T10:31:44.594411+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:31:44.594411+0000","last_undegraded":"2024-09-18T10:31:44.594411+0000","last_fullsized":"2024-09-18T10:31:44.594411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:31:01.041556+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:18.088256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600837+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:31:44.600837+0000","last_peered":"2024-09-18T10:31:44.600837+0000","last_clean":"2024-09-18T10:31:44.600837+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:31:44.600837+0000","last_undegraded":"2024-09-18T10:31:44.600837+0000","last_fullsized":"2024-09-18T10:31:44.600837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"44'10","reported_seq":97,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.601241+0000","last_change":"2024-09-18T10:31:44.601241+0000","last_active":"2024-09-18T10:31:44.601241+0000","last_peered":"2024-09-18T10:31:44.601241+0000","last_clean":"2024-09-18T10:31:44.601241+0000","last_became_active":"2024-09-18T10:31:19.656832+0000","last_became_peered":"2024-09-18T10:31:19.656832+0000","last_unstale":"2024-09-18T10:31:44.601241+0000","last_undegraded":"2024-09-18T10:31:44.601241+0000","last_fullsized":"2024-09-18T10:31:44.601241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:45.003864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051836099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.604467+0000","last_change":"2024-09-18T10:31:07.643595+0000","last_active":"2024-09-18T10:31:44.604467+0000","last_peered":"2024-09-18T10:31:44.604467+0000","last_clean":"2024-09-18T10:31:44.604467+0000","last_became_active":"2024-09-18T10:31:05.535527+0000","last_became_peered":"2024-09-18T10:31:05.535527+0000","last_unstale":"2024-09-18T10:31:44.604467+0000","last_undegraded":"2024-09-18T10:31:44.604467+0000","last_fullsized":"2024-09-18T10:31:44.604467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.163559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030261699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"60'36","reported_seq":138,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.608281+0000","last_change":"2024-09-18T10:31:44.602234+0000","last_active":"2024-09-18T10:31:44.608281+0000","last_peered":"2024-09-18T10:31:44.608281+0000","last_clean":"2024-09-18T10:31:44.608281+0000","last_became_active":"2024-09-18T10:31:19.657050+0000","last_became_peered":"2024-09-18T10:31:19.657050+0000","last_unstale":"2024-09-18T10:31:44.608281+0000","last_undegraded":"2024-09-18T10:31:44.608281+0000","last_fullsized":"2024-09-18T10:31:44.608281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.836363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046776320000000001,"stat_sum":{"num_bytes":5275648,"num_objects":8,"num_object_clones":3,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":26,"num_read_kb":7114,"num_write":22,"num_write_kb":5536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600660+0000","last_change":"2024-09-18T10:31:07.426770+0000","last_active":"2024-09-18T10:31:44.600660+0000","last_peered":"2024-09-18T10:31:44.600660+0000","last_clean":"2024-09-18T10:31:44.600660+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:31:44.600660+0000","last_undegraded":"2024-09-18T10:31:44.600660+0000","last_fullsized":"2024-09-18T10:31:44.600660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:15.433492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"60'64","reported_seq":151,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.622870+0000","last_change":"2024-09-18T10:31:44.622870+0000","last_active":"2024-09-18T10:31:44.622870+0000","last_peered":"2024-09-18T10:31:44.622870+0000","last_clean":"2024-09-18T10:31:44.622870+0000","last_became_active":"2024-09-18T10:31:19.653500+0000","last_became_peered":"2024-09-18T10:31:19.653500+0000","last_unstale":"2024-09-18T10:31:44.622870+0000","last_undegraded":"2024-09-18T10:31:44.622870+0000","last_fullsized":"2024-09-18T10:31:44.622870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:20.537620+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.021388885999999999,"stat_sum":{"num_bytes":9453568,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":34,"num_write_kb":10672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,9,2,6,15,4],"acting":[3,7,9,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":48,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.599858+0000","last_change":"2024-09-18T10:31:07.190910+0000","last_active":"2024-09-18T10:31:44.599858+0000","last_peered":"2024-09-18T10:31:44.599858+0000","last_clean":"2024-09-18T10:31:44.599858+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:31:44.599858+0000","last_undegraded":"2024-09-18T10:31:44.599858+0000","last_fullsized":"2024-09-18T10:31:44.599858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:05.745490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":86,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.609696+0000","last_change":"2024-09-18T10:31:44.609696+0000","last_active":"2024-09-18T10:31:44.609696+0000","last_peered":"2024-09-18T10:31:44.609696+0000","last_clean":"2024-09-18T10:31:44.609696+0000","last_became_active":"2024-09-18T10:31:19.653308+0000","last_became_peered":"2024-09-18T10:31:19.653308+0000","last_unstale":"2024-09-18T10:31:44.609696+0000","last_undegraded":"2024-09-18T10:31:44.609696+0000","last_fullsized":"2024-09-18T10:31:44.609696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:48.003091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020009110000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4,13,11,2,5],"acting":[10,9,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.5","version":"60'32","reported_seq":120,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.606846+0000","last_change":"2024-09-18T10:31:44.606846+0000","last_active":"2024-09-18T10:31:44.606846+0000","last_peered":"2024-09-18T10:31:44.606846+0000","last_clean":"2024-09-18T10:31:44.606846+0000","last_became_active":"2024-09-18T10:31:19.654834+0000","last_became_peered":"2024-09-18T10:31:19.654834+0000","last_unstale":"2024-09-18T10:31:44.606846+0000","last_undegraded":"2024-09-18T10:31:44.606846+0000","last_fullsized":"2024-09-18T10:31:44.606846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:30.217482+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0095991150000000001,"stat_sum":{"num_bytes":540672,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":10,"num_read_kb":5,"num_write":17,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,11],"acting":[5,8,4,9,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-18T10:31:43.594650+0000","last_change":"2024-09-18T10:31:07.183807+0000","last_active":"2024-09-18T10:31:43.594650+0000","last_peered":"2024-09-18T10:31:43.594650+0000","last_clean":"2024-09-18T10:31:43.594650+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:31:43.594650+0000","last_undegraded":"2024-09-18T10:31:43.594650+0000","last_fullsized":"2024-09-18T10:31:43.594650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:14.697405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"60'48","reported_seq":138,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.617537+0000","last_change":"2024-09-18T10:31:44.617537+0000","last_active":"2024-09-18T10:31:44.617537+0000","last_peered":"2024-09-18T10:31:44.617537+0000","last_clean":"2024-09-18T10:31:44.617537+0000","last_became_active":"2024-09-18T10:31:19.653632+0000","last_became_peered":"2024-09-18T10:31:19.653632+0000","last_unstale":"2024-09-18T10:31:44.617537+0000","last_undegraded":"2024-09-18T10:31:44.617537+0000","last_fullsized":"2024-09-18T10:31:44.617537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:42.743288+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.017228988000000001,"stat_sum":{"num_bytes":4833280,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":15,"num_read_kb":6391,"num_write":38,"num_write_kb":4720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600979+0000","last_change":"2024-09-18T10:31:07.426525+0000","last_active":"2024-09-18T10:31:44.600979+0000","last_peered":"2024-09-18T10:31:44.600979+0000","last_clean":"2024-09-18T10:31:44.600979+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:31:44.600979+0000","last_undegraded":"2024-09-18T10:31:44.600979+0000","last_fullsized":"2024-09-18T10:31:44.600979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:11.358272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"60'68","reported_seq":170,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.623821+0000","last_change":"2024-09-18T10:31:44.624499+0000","last_active":"2024-09-18T10:31:44.623821+0000","last_peered":"2024-09-18T10:31:44.623821+0000","last_clean":"2024-09-18T10:31:44.623821+0000","last_became_active":"2024-09-18T10:31:19.259917+0000","last_became_peered":"2024-09-18T10:31:19.259917+0000","last_unstale":"2024-09-18T10:31:44.623821+0000","last_undegraded":"2024-09-18T10:31:44.623821+0000","last_fullsized":"2024-09-18T10:31:44.623821+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.414788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026851085,"stat_sum":{"num_bytes":5668864,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":11523,"num_write":51,"num_write_kb":6928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600722+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:31:44.600722+0000","last_peered":"2024-09-18T10:31:44.600722+0000","last_clean":"2024-09-18T10:31:44.600722+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:31:44.600722+0000","last_undegraded":"2024-09-18T10:31:44.600722+0000","last_fullsized":"2024-09-18T10:31:44.600722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"49'50","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.604146+0000","last_change":"2024-09-18T10:31:44.604946+0000","last_active":"2024-09-18T10:31:44.604146+0000","last_peered":"2024-09-18T10:31:44.604146+0000","last_clean":"2024-09-18T10:31:44.604146+0000","last_became_active":"2024-09-18T10:31:19.653910+0000","last_became_peered":"2024-09-18T10:31:19.653910+0000","last_unstale":"2024-09-18T10:31:44.604146+0000","last_undegraded":"2024-09-18T10:31:44.604146+0000","last_fullsized":"2024-09-18T10:31:44.604146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.757231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011289259999999999,"stat_sum":{"num_bytes":5537792,"num_objects":8,"num_object_clones":2,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":7876,"num_write":64,"num_write_kb":5408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,9,15],"acting":[0,14,6,2,5,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-18T10:31:44.600701+0000","last_change":"2024-09-18T10:31:07.190486+0000","last_active":"2024-09-18T10:31:44.600701+0000","last_peered":"2024-09-18T10:31:44.600701+0000","last_clean":"2024-09-18T10:31:44.600701+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:31:44.600701+0000","last_undegraded":"2024-09-18T10:31:44.600701+0000","last_fullsized":"2024-09-18T10:31:44.600701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:19.281798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":59097088,"num_objects":81,"num_object_clones":36,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":6,"num_read":231,"num_read_kb":50390,"num_write":434,"num_write_kb":67216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105902080,"data_stored":135806976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":565,"ondisk_log_size":565,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306112,"kb_used_data":8752,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065728,"statfs":{"total":96636764160,"available":96323305472,"internally_reserved":0,"allocated":8962048,"data_stored":11010756,"data_compressed":125137,"data_compressed_allocated":192512,"data_compressed_original":831488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":14,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308300,"kb_used_data":10944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94063540,"statfs":{"total":96636764160,"available":96321064960,"internally_reserved":0,"allocated":11206656,"data_stored":14655652,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304776,"kb_used_data":7412,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067064,"statfs":{"total":96636764160,"available":96324673536,"internally_reserved":0,"allocated":7589888,"data_stored":10066098,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":21,"seq":90194313228,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305444,"kb_used_data":8080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066396,"statfs":{"total":96636764160,"available":96323989504,"internally_reserved":0,"allocated":8273920,"data_stored":9967775,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,5,6,7,8,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":21,"seq":90194313229,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301320,"kb_used_data":3956,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070520,"statfs":{"total":96636764160,"available":96328212480,"internally_reserved":0,"allocated":4050944,"data_stored":4364447,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313229,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":9920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":10158080,"data_stored":11724959,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":2,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306412,"kb_used_data":9056,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065428,"statfs":{"total":96636764160,"available":96322998272,"internally_reserved":0,"allocated":9273344,"data_stored":10891428,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,9,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":3,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306016,"kb_used_data":8652,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065824,"statfs":{"total":96636764160,"available":96323403776,"internally_reserved":0,"allocated":8859648,"data_stored":11094175,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":4528,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":4636672,"data_stored":6594724,"data_compressed":115212,"data_compressed_allocated":159744,"data_compressed_original":319488,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":6,"up_from":22,"seq":94489280523,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305448,"kb_used_data":8092,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066392,"statfs":{"total":96636764160,"available":96323985408,"internally_reserved":0,"allocated":8286208,"data_stored":10291903,"data_compressed":122167,"data_compressed_allocated":188416,"data_compressed_original":823296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":7,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304500,"kb_used_data":7136,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067340,"statfs":{"total":96636764160,"available":96324956160,"internally_reserved":0,"allocated":7307264,"data_stored":9062559,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":8,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300956,"kb_used_data":3592,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070884,"statfs":{"total":96636764160,"available":96328585216,"internally_reserved":0,"allocated":3678208,"data_stored":4933791,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":9,"up_from":22,"seq":94489280523,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301816,"kb_used_data":4452,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94070024,"statfs":{"total":96636764160,"available":96327704576,"internally_reserved":0,"allocated":4558848,"data_stored":5208223,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":10,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304240,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067600,"statfs":{"total":96636764160,"available":96325222400,"internally_reserved":0,"allocated":7041024,"data_stored":8116383,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":11,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304340,"kb_used_data":6976,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94067500,"statfs":{"total":96636764160,"available":96325120000,"internally_reserved":0,"allocated":7143424,"data_stored":8358047,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":12,"up_from":22,"seq":94489280524,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302144,"kb_used_data":4780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94069696,"statfs":{"total":96636764160,"available":96327368704,"internally_reserved":0,"allocated":4894720,"data_stored":6391986,"data_compressed":112242,"data_compressed_allocated":155648,"data_compressed_original":311296,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7606272,"data_stored":9523200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8593408,"data_stored":10436608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192000,"data_stored":10649600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9490432,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3956736,"data_stored":6139904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":9945088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6639616,"data_stored":8617984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":4497408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4304896,"data_stored":5398528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":6373376,"data_stored":7671808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6475776,"data_stored":7921664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4222976,"data_stored":5947392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6918144,"data_stored":9629696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":14200832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":8228864,"data_stored":10027008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:31:48.070 INFO:tasks.thrashosds.thrasher:Setting 1.0 to [1, 13, 5, 12] 2024-09-18T10:31:48.070 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '1.0', '1', '13', '5', '12'] 2024-09-18T10:31:48.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 1.0 1 13 5 12 2024-09-18T10:31:48.142 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:48.142+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.156 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:48.244 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:48.242+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.270 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:48.345 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:48.344+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:48.381 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.381 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:48.446 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:48.444+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:48.532 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.532 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:48.547 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:48.545+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:48.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:31:48.642 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.642 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.647 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:48.646+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:48.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:48.657 INFO:teuthology.orchestra.run.smithi063.stderr:set 1.0 pg_upmap_items mapping to [1->13,5->12] 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:205: done (2 left) 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:206: delete oid 29 current snap is 14 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:203: finishing write tid 1 to smithi16036501-9 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:203: finishing write tid 2 to smithi16036501-9 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:203: finishing write tid 3 to smithi16036501-9 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:203: finishing write tid 4 to smithi16036501-9 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:203: finishing write tid 5 to smithi16036501-9 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 9 v 21 (ObjNum 102 snap 14 seq_num 102) dirty exists 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:203: left oid 9 (ObjNum 102 snap 14 seq_num 102) 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:204: finishing write tid 1 to smithi16036501-49 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:204: finishing write tid 2 to smithi16036501-49 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:204: finishing write tid 3 to smithi16036501-49 2024-09-18T10:31:48.658 INFO:tasks.rados.rados.0.smithi160.stdout:204: finishing write tid 4 to smithi16036501-49 2024-09-18T10:31:48.659 INFO:tasks.rados.rados.0.smithi160.stdout:204: finishing write tid 5 to smithi16036501-49 2024-09-18T10:31:48.659 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 49 v 42 (ObjNum 103 snap 14 seq_num 103) dirty exists 2024-09-18T10:31:48.659 INFO:tasks.rados.rados.0.smithi160.stdout:204: left oid 49 (ObjNum 103 snap 14 seq_num 103) 2024-09-18T10:31:48.661 INFO:tasks.rados.rados.0.smithi160.stdout:203: done (2 left) 2024-09-18T10:31:48.662 INFO:tasks.rados.rados.0.smithi160.stdout:204: done (1 left) 2024-09-18T10:31:48.662 INFO:tasks.rados.rados.0.smithi160.stdout:206: done (0 left) 2024-09-18T10:31:48.662 INFO:tasks.rados.rados.0.smithi160.stdout:207: read oid 38 snap -1 2024-09-18T10:31:48.662 INFO:tasks.rados.rados.0.smithi160.stdout:207: expect (ObjNum 94 snap 12 seq_num 94) 2024-09-18T10:31:48.662 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 1 current snap is 14 2024-09-18T10:31:48.662 INFO:tasks.rados.rados.0.smithi160.stdout:208: seq_num 105 ranges {884736=606208,1490944=688128,2179072=475136} 2024-09-18T10:31:48.671 INFO:tasks.rados.rados.0.smithi160.stdout:208: writing smithi16036501-1 from 884736 to 1490944 tid 1 2024-09-18T10:31:48.675 INFO:tasks.rados.rados.0.smithi160.stdout:208: writing smithi16036501-1 from 1490944 to 2179072 tid 2 2024-09-18T10:31:48.679 INFO:tasks.rados.rados.0.smithi160.stdout:208: writing smithi16036501-1 from 2179072 to 2654208 tid 3 2024-09-18T10:31:48.679 INFO:tasks.rados.rados.0.smithi160.stdout:209: snap_create 2024-09-18T10:31:48.690 INFO:tasks.rados.rados.0.smithi160.stdout:208: finishing write tid 1 to smithi16036501-1 2024-09-18T10:31:48.692 INFO:tasks.rados.rados.0.smithi160.stdout:208: finishing write tid 2 to smithi16036501-1 2024-09-18T10:31:48.694 INFO:tasks.rados.rados.0.smithi160.stdout:208: finishing write tid 3 to smithi16036501-1 2024-09-18T10:31:48.694 INFO:tasks.rados.rados.0.smithi160.stdout:208: finishing write tid 4 to smithi16036501-1 2024-09-18T10:31:48.695 INFO:tasks.rados.rados.0.smithi160.stdout:208: finishing write tid 5 to smithi16036501-1 2024-09-18T10:31:48.695 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 1 v 78 (ObjNum 105 snap 14 seq_num 105) dirty exists 2024-09-18T10:31:48.695 INFO:tasks.rados.rados.0.smithi160.stdout:208: left oid 1 (ObjNum 105 snap 14 seq_num 105) 2024-09-18T10:31:48.703 INFO:tasks.rados.rados.0.smithi160.stdout:207: expect (ObjNum 94 snap 12 seq_num 94) 2024-09-18T10:31:48.748 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:48.746+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:48.776 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.776 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:48.849 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:48.848+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:48.882 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:48.883 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:48.891 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:48.919 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:48.950 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:48.949+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:49.029 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:49.030 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:49.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:49.038 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:49.039 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:49.051 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:49.049+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:49.054 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:49.055 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:49.071 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:49.071 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:49.087 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:49.087 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:49.102 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:49.102 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:49.118 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:49.119 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:49.134 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:49.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:49.151 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:49.151 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:49.152 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:49.149+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:49.166 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:49.166 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:49.181 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:49.182 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:49.197 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:49.198 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:49.213 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:49.213 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:49.228 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:49.228 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:49.242 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:49.242 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:49.243 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:49.243 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:49.243 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:49.243 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:49.244 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:49.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:49.254 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:49.252+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:49.259 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:49.259 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:49.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:49.259+0000 7f5cd5bc8640 0 -- 172.21.15.63:0/1997460258 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7f5cd0195c80 msgr2=0x7f5cd0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-18T10:31:49.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:204 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.269997+0000", 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.079386005, 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071129189999999997, 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 204 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.269997+0000", 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.269997+0000", 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.269996+0000", 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270006+0000", 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0429e-05 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270023+0000", 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7356000000000001e-05 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270030+0000", 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4570000000000002e-06 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270084+0000", 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4651000000000002e-05 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270092+0000", 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4569999999999999e-06 2024-09-18T10:31:49.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274309+0000", 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042174420000000001 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274367+0000", 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7979000000000002e-05 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.277110+0000", 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027430319999999998 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:205 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.079340694999999, 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076111369999999996, 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:49.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 205 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270042+0000", 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270046+0000", 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4120000000000001e-06 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270052+0000", 2024-09-18T10:31:49.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6279999999999999e-06 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270056+0000", 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3749999999999999e-06 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270134+0000", 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8008000000000003e-05 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270137+0000", 2024-09-18T10:31:49.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.574e-06 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274639+0000", 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045012020000000002 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274720+0000", 2024-09-18T10:31:49.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1095999999999997e-05 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.277654+0000", 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029342470000000001 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:206 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.079309838, 2024-09-18T10:31:49.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081552699999999992, 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270073+0000", 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270076+0000", 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1389999999999999e-06 2024-09-18T10:31:49.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270082+0000", 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8329999999999999e-06 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270087+0000", 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7589999999999997e-06 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270158+0000", 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1110000000000002e-05 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270163+0000", 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1370000000000001e-06 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275879+0000", 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005716133 2024-09-18T10:31:49.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275935+0000", 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5587999999999997e-05 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.278229+0000", 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022939829999999999 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 45/33 ECSubWrite(tid=51, reqid=client.4589.0:297, at_version=45'43, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.025082234999999, 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078576380000000001, 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324924+0000", 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062299700000000003 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324936+0000", 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1817000000000001e-05 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324943+0000", 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3509999999999996e-06 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324996+0000", 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3429e-05 2024-09-18T10:31:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325006+0000", 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.115e-06 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332137+0000", 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071312069999999997 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332159+0000", 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2137000000000002e-05 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 45/33 ECSubWrite(tid=79, reqid=client.4589.0:295, at_version=45'24, trim_to=0'0, roll_forward_to=44'22))", 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324529+0000", 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.024854737999998, 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076180930000000003, 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324529+0000", 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324529+0000", 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324528+0000", 2024-09-18T10:31:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324806+0000", 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027733199999999998 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324819+0000", 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3662000000000001e-05 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324828+0000", 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6330000000000002e-06 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324885+0000", 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7207999999999998e-05 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324896+0000", 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0817e-05 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332114+0000", 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072178320000000004 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332147+0000", 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2851000000000001e-05 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 45/33 ECSubWrite(tid=52, reqid=client.4589.0:298, at_version=45'44, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.327133+0000", 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.022250853999999, 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080173789999999998, 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327133+0000", 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327133+0000", 2024-09-18T10:31:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327132+0000", 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327317+0000", 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000185465 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327347+0000", 2024-09-18T10:31:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9408999999999999e-05 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327353+0000", 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3820000000000001e-06 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327395+0000", 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2193000000000001e-05 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327406+0000", 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0825999999999999e-05 2024-09-18T10:31:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335130+0000", 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077239659999999996 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335150+0000", 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9848e-05 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:436 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~770048] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6271548150000008, 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011429902, 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 436 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:31:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722227+0000", 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723088+0000", 2024-09-18T10:31:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086064300000000002 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723103+0000", 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5194000000000001e-05 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723126+0000", 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3286e-05 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723184+0000", 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8409000000000003e-05 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723195+0000", 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0127e-05 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725088+0000", 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932479999999999 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725155+0000", 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7061e-05 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.726518+0000", 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001363076 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730117+0000", 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003598778 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733596+0000", 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034793699999999999 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733659+0000", 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2459999999999995e-05 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:437 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~475136] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6240140590000003, 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013490482, 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 437 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725368+0000", 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725831+0000", 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046283199999999999 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725844+0000", 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3121e-05 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725851+0000", 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.674e-06 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727646+0000", 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017952199999999999 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727719+0000", 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3166999999999999e-05 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728450+0000", 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073089599999999998 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730201+0000", 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001750564 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738806+0000", 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008605171 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738860+0000", 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4008999999999997e-05 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:438 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~294912] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6222896589999998, 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01193583, 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 438 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727093+0000", 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727437+0000", 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034437500000000001 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727451+0000", 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4089e-05 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727463+0000", 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2179e-05 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728987+0000", 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015242299999999999 2024-09-18T10:31:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729057+0000", 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9201000000000004e-05 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729526+0000", 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046947999999999998 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731168+0000", 2024-09-18T10:31:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016422959999999999 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738978+0000", 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078093099999999999 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739030+0000", 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1910999999999998e-05 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:439 3.5s0 3:ac3be3d0:::smithi16036501-3:head [setxattr _header (56) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6219119249999991, 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011721551, 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 439 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727471+0000", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727476+0000", 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1399999999999999e-06 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727485+0000", 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4590000000000004e-06 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727492+0000", 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4450000000000001e-06 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730312+0000", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028200730000000002 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730376+0000", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3989e-05 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730729+0000", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353099 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731679+0000", 2024-09-18T10:31:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095002300000000003 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739133+0000", 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074541119999999997 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739193+0000", 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0016000000000003e-05 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:440 3.5s0 3:ac3be3d0:::smithi16036501-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6218843940000003, 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013207774, 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 440 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727503+0000", 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2220000000000004e-06 2024-09-18T10:31:49.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727512+0000", 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1789999999999997e-06 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727521+0000", 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730982+0000", 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003461357 2024-09-18T10:31:49.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731094+0000", 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011191700000000001 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739479+0000", 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083848180000000005 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739571+0000", 2024-09-18T10:31:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1942999999999997e-05 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.740707+0000", 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011359429999999999 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:450 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~786432] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.5705780090000001, 2024-09-18T10:31:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083772540000000006, 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 450 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778803+0000", 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779445+0000", 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064144400000000002 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779458+0000", 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3027000000000001e-05 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779462+0000", 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5859999999999998e-06 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779514+0000", 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1320000000000003e-05 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779580+0000", 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6484999999999998e-05 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.780535+0000", 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095481799999999996 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.781925+0000", 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013899489999999999 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787115+0000", 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051898500000000002 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787183+0000", 2024-09-18T10:31:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8021999999999993e-05 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:454 3.cs0 3:3616aa10:::smithi16036501-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.785155+0000", 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.5642286599999995, 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073055749999999999, 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 454 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785155+0000", 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785155+0000", 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785154+0000", 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785157+0000", 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7310000000000002e-06 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785164+0000", 2024-09-18T10:31:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.669e-06 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785168+0000", 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8619999999999996e-06 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787392+0000", 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022244439999999999 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787462+0000", 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9846999999999997e-05 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.791537+0000", 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040754010000000002 2024-09-18T10:31:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.791601+0000", 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3668000000000001e-05 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.792460+0000", 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085944500000000002 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:456 3.5s0 3:ac3be3d0:::smithi16036501-3:head [copy-from ver 4] snapc 13=[d,6] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.709132898, 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01601, 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 456 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640248+0000", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640263+0000", 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4487e-05 2024-09-18T10:31:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640282+0000", 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9524000000000001e-05 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640289+0000", 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5939999999999999e-06 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:31:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9294000000000004e-05 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640367+0000", 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0170000000000002e-06 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645378+0000", 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050108269999999998 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645496+0000", 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118449 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.649412+0000", 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039156800000000004 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650429+0000", 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00101706 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656201+0000", 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057721049999999996 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656261+0000", 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9450999999999997e-05 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:457 3.5s0 3:ac3be3d0:::smithi16036501-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7090787110000001, 2024-09-18T10:31:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099350510000000003, 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 457 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640304+0000", 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640308+0000", 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.631e-06 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640315+0000", 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4590000000000001e-06 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640319+0000", 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.721e-06 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640554+0000", 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000235047 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640562+0000", 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1110000000000008e-06 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645694+0000", 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051315149999999997 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645744+0000", 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0756e-05 2024-09-18T10:31:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650099+0000", 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043545509999999999 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650157+0000", 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8363999999999999e-05 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650240+0000", 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2596000000000007e-05 2024-09-18T10:31:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 56/33 ECSubWrite(tid=125, reqid=osd.13.0:125, at_version=56'33, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6945509140000006, 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084899620000000002, 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654832+0000", 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654874+0000", 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1996999999999998e-05 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654890+0000", 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6705999999999999e-05 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654898+0000", 2024-09-18T10:31:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-09-18T10:31:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654955+0000", 2024-09-18T10:31:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7389000000000002e-05 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654966+0000", 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1353e-05 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663290+0000", 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083236720000000007 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663323+0000", 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2360999999999997e-05 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:485 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:31:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7539901389999999, 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092164380000000004, 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 485 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595391+0000", 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595401+0000", 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559999999999994e-06 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595421+0000", 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.052e-05 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595430+0000", 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8149999999999995e-06 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595492+0000", 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2297000000000003e-05 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0696999999999999e-05 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597238+0000", 2024-09-18T10:31:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017347510000000001 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597314+0000", 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5784000000000005e-05 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597920+0000", 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060640599999999998 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600840+0000", 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029203670000000001 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604512+0000", 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036712759999999998 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:31:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8109000000000005e-05 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:486 3.cs0 3:3616aa10:::smithi16036501-19:head [rollback 17] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7539054780000001, 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095267909999999997, 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 486 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:31:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595477+0000", 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595482+0000", 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9559999999999996e-06 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595489+0000", 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.866e-06 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595493+0000", 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4630000000000001e-06 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595574+0000", 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1390999999999994e-05 2024-09-18T10:31:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595580+0000", 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2330000000000003e-06 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598599+0000", 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003018813 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598675+0000", 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6198000000000005e-05 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.599265+0000", 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058946400000000005 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604855+0000", 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055906949999999997 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604930+0000", 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5139e-05 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605005+0000", 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4320000000000007e-05 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:487 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7538853339999996, 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015332254999999999, 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 487 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595500+0000", 2024-09-18T10:31:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7999999999999999e-06 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3380000000000001e-06 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595505+0000", 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2419999999999999e-06 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595603+0000", 2024-09-18T10:31:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7980999999999996e-05 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595610+0000", 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5710000000000003e-06 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600005+0000", 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043948529999999998 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600140+0000", 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135184 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600625+0000", 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048546199999999998 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605009+0000", 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043837019999999997 2024-09-18T10:31:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610750+0000", 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057406339999999997 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610830+0000", 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0711999999999996e-05 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 61/33 ECSubWrite(tid=74, reqid=client.4589.0:494, at_version=61'54, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.604314+0000", 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7450693900000003, 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070638760000000002, 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604314+0000", 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604314+0000", 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604313+0000", 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604332+0000", 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8527000000000001e-05 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604345+0000", 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.359e-05 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604352+0000", 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8000000000000001e-06 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604392+0000", 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0157999999999997e-05 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604401+0000", 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.704e-06 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.611352+0000", 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069505519999999996 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.611378+0000", 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6381999999999999e-05 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.459 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:49.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:49.461 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:49.459+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:49.477 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:49.477 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:49.561 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:49.560+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:49.597 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:49.708 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:49.709 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:49.709 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:49.710 INFO:tasks.rados.rados.0.smithi160.stdout:207: done (2 left) 2024-09-18T10:31:49.711 INFO:tasks.rados.rados.0.smithi160.stdout:208: done (1 left) 2024-09-18T10:31:49.711 INFO:tasks.rados.rados.0.smithi160.stdout:209: done (0 left) 2024-09-18T10:31:49.711 INFO:tasks.rados.rados.0.smithi160.stdout:210: copy_from oid 12 from oid 41 current snap is 15 2024-09-18T10:31:49.711 INFO:tasks.rados.rados.0.smithi160.stdout:211: snap_remove snap 14 2024-09-18T10:31:49.711 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:31:49.712 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:49.712 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:49.709+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:49.810 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:49.810 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:49.810 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:49.811 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:49.811 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:49.811 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:49.810+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:49.819 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:49.911 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:49.909+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.636387208999999, 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002559342, 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280419+0000", 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078655700000000001 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280432+0000", 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2958e-05 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280439+0000", 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1930000000000004e-06 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280487+0000", 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7725000000000001e-05 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280495+0000", 2024-09-18T10:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9109999999999993e-06 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.282168+0000", 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016732850000000001 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.282192+0000", 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3839e-05 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=30, reqid=client.4589.0:208, at_version=39'20, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.634565856000002, 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003011279, 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281453+0000", 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281781+0000", 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032834699999999999 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281791+0000", 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1910000000000006e-06 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281795+0000", 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1470000000000003e-06 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281830+0000", 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5163999999999997e-05 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281849+0000", 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9228e-05 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284446+0000", 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025973480000000002 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284465+0000", 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8488999999999999e-05 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=51, reqid=client.4589.0:297, at_version=45'43, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.590668609000002, 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069162599999999996, 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325429+0000", 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7943999999999998e-05 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325439+0000", 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0818e-05 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325449+0000", 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9930000000000007e-06 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325505+0000", 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5464000000000003e-05 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325516+0000", 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0730000000000001e-05 2024-09-18T10:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332243+0000", 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067279690000000003 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332267+0000", 2024-09-18T10:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3694e-05 2024-09-18T10:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=52, reqid=client.4589.0:298, at_version=45'44, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.587684316000001, 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068793300000000003, 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328880+0000", 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054557 2024-09-18T10:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328890+0000", 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7210000000000006e-06 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328896+0000", 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9900000000000002e-06 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328936+0000", 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0389000000000002e-05 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328944+0000", 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9240000000000007e-06 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335192+0000", 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062478330000000004 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335215+0000", 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2484e-05 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=53, reqid=client.4589.0:299, at_version=45'45, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.587114439, 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063241030000000002, 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328978+0000", 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3480999999999997e-05 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328986+0000", 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2709999999999992e-06 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328997+0000", 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.027e-05 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329554+0000", 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00055778200000000005 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329565+0000", 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0132000000000001e-05 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335219+0000", 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056541919999999997 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335229+0000", 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0404999999999999e-05 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=54, reqid=client.4589.0:300, at_version=45'46, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.330132+0000", 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.585887992, 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051063660000000002, 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330132+0000", 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330132+0000", 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330131+0000", 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330148+0000", 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7533e-05 2024-09-18T10:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330160+0000", 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1565e-05 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330166+0000", 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0039999999999996e-06 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330209+0000", 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3446999999999999e-05 2024-09-18T10:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330218+0000", 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3319999999999992e-06 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335232+0000", 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005013974 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335238+0000", 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.246e-06 2024-09-18T10:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.5s3 49/33 ECSubWrite(tid=62, reqid=osd.5.0:61, at_version=0'0, trim_to=0'0, roll_forward_to=49'16))", 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.594877+0000", 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.321142822999999, 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023051909999999998, 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594877+0000", 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594877+0000", 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594876+0000", 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594898+0000", 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1682e-05 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594915+0000", 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7963000000000001e-05 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594925+0000", 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6330000000000008e-06 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594970+0000", 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4393e-05 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594979+0000", 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6199999999999994e-06 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.597156+0000", 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021764129999999999 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.597182+0000", 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.637e-05 2024-09-18T10:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 49/33 ECSubWrite(tid=40, reqid=osd.3.0:40, at_version=49'29, trim_to=0'0, roll_forward_to=48'27))", 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.596268+0000", 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.319752008999998, 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027377209999999998, 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596268+0000", 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596268+0000", 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596267+0000", 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596317+0000", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9401999999999999e-05 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596330+0000", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596357+0000", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6775999999999999e-05 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596437+0000", 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9275000000000002e-05 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596445+0000", 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8389999999999996e-06 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.598979+0000", 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025338829999999998 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.599005+0000", 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.603e-05 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 49/33 ECSubWrite(tid=65, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.603841+0000", 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.312178833000001, 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034843650000000001, 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603841+0000", 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603841+0000", 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603840+0000", 2024-09-18T10:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603850+0000", 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0112000000000001e-05 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603859+0000", 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1400000000000006e-06 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603866+0000", 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604013+0000", 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147004 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604024+0000", 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0681e-05 2024-09-18T10:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607298+0000", 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032736610000000002 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607325+0000", 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7385999999999998e-05 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 49/33 ECSubWrite(tid=41, reqid=osd.3.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=49'29))", 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.312134177000001, 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034793089999999999, 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603894+0000", 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2879999999999998e-06 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603904+0000", 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0057999999999999e-05 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603911+0000", 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0539999999999997e-06 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604082+0000", 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017050400000000001 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604091+0000", 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5019999999999998e-06 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607335+0000", 2024-09-18T10:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032431880000000001 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607365+0000", 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0117999999999999e-05 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 55/33 ECSubWrite(tid=54, reqid=client.4589.0:422, at_version=55'42, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.654474+0000", 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.261545456, 2024-09-18T10:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022341819999999999, 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654474+0000", 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654474+0000", 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654474+0000", 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654872+0000", 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00039809399999999999 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654888+0000", 2024-09-18T10:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5889999999999999e-05 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654898+0000", 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0027000000000001e-05 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654968+0000", 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0137999999999998e-05 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.654979+0000", 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0512e-05 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.656678+0000", 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016998530000000001 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.656708+0000", 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9811e-05 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds4 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2725563970000007, 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022391339999999998, 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643487+0000", 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4294000000000002e-05 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643501+0000", 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3389e-05 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643508+0000", 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5089999999999996e-06 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643587+0000", 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9002e-05 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643598+0000", 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0669000000000001e-05 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645670+0000", 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020720959999999998 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645702+0000", 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2438999999999999e-05 2024-09-18T10:31:49.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/33 ECSubWrite(tid=87, reqid=client.4589.0:456, at_version=0'0, trim_to=0'0, roll_forward_to=56'26))", 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.656430+0000", 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2595899520000007, 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069584759999999999, 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656430+0000", 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656430+0000", 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656429+0000", 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656446+0000", 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7714e-05 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656461+0000", 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4884e-05 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656468+0000", 2024-09-18T10:31:49.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1250000000000004e-06 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656533+0000", 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5114e-05 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656544+0000", 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0522e-05 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663361+0000", 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068171430000000003 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663388+0000", 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6965e-05 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.978 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 60/33 ECSubWrite(tid=72, reqid=osd.3.0:72, at_version=60'60, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.312948155, 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029421450000000002, 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603095+0000", 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3901999999999999e-05 2024-09-18T10:31:49.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603128+0000", 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2861999999999998e-05 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603135+0000", 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0180000000000004e-06 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603227+0000", 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1874999999999997e-05 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603237+0000", 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0370000000000001e-05 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605988+0000", 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027506900000000001 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.606014+0000", 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5664999999999999e-05 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 60/33 ECSubWrite(tid=74, reqid=osd.3.0:73, at_version=0'0, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3029640799999997, 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003567321, 2024-09-18T10:31:49.983 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613065+0000", 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0706e-05 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613077+0000", 2024-09-18T10:31:49.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613082+0000", 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.938e-06 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613129+0000", 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6600000000000001e-05 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613137+0000", 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1799999999999996e-06 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616600+0000", 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034632859999999999 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616623+0000", 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2679000000000001e-05 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.987 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 60/33 ECSubWrite(tid=75, reqid=osd.3.0:75, at_version=60'64, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613926+0000", 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3020936660000002, 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055868000000000003, 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613926+0000", 2024-09-18T10:31:49.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613926+0000", 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613925+0000", 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613952+0000", 2024-09-18T10:31:49.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7118999999999999e-05 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613972+0000", 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0064999999999998e-05 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613990+0000", 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7569000000000001e-05 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614056+0000", 2024-09-18T10:31:49.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6619999999999996e-05 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614066+0000", 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9280000000000005e-06 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619488+0000", 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054218870000000002 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619513+0000", 2024-09-18T10:31:49.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4457999999999999e-05 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds4 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.601746+0000", 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3142739109999999, 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007718183, 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601746+0000", 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601746+0000", 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601745+0000", 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601831+0000", 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5568999999999993e-05 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601846+0000", 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4661000000000001e-05 2024-09-18T10:31:49.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601854+0000", 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.371e-06 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601916+0000", 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1904999999999998e-05 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601931+0000", 2024-09-18T10:31:49.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4762e-05 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609440+0000", 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075092149999999996 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609464+0000", 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4031000000000001e-05 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:49.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/33 ECSubWrite(tid=72, reqid=client.4589.0:492, at_version=61'52, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3138073119999998, 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035819210000000001, 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602266+0000", 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4305000000000003e-05 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602279+0000", 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2798e-05 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602286+0000", 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0570000000000004e-06 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602357+0000", 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0517000000000003e-05 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:49.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602368+0000", 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1663e-05 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.605769+0000", 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003400953 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.605794+0000", 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4868e-05 2024-09-18T10:31:50.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/33 ECSubWrite(tid=73, reqid=client.4589.0:493, at_version=61'53, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.603383+0000", 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3126365159999995, 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056686879999999999, 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603383+0000", 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603383+0000", 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603382+0000", 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603404+0000", 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1469999999999999e-05 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603419+0000", 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5167999999999999e-05 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603426+0000", 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1670000000000002e-06 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603472+0000", 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5704999999999997e-05 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603482+0000", 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0536e-05 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609014+0000", 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005531757 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609052+0000", 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7796000000000002e-05 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/33 ECSubWrite(tid=74, reqid=client.4589.0:494, at_version=61'54, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.604365+0000", 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.311654334, 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004703451, 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.005 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604365+0000", 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604365+0000", 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604364+0000", 2024-09-18T10:31:50.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604386+0000", 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1209999999999999e-05 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604402+0000", 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6286999999999998e-05 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604410+0000", 2024-09-18T10:31:50.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0639999999999994e-06 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604462+0000", 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2392999999999998e-05 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604474+0000", 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1552999999999999e-05 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609056+0000", 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004582526 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609069+0000", 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2278e-05 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.009 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:50.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:50.012 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:50.011+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:50.109 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:50.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:50.109 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:50.109 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:50.113 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:50.112+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:50.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:50.214 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:50.213+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:50.214 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:50.214 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:50.214 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:50.214 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:50.214 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:50.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:50.315 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:50.314+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:31:50.322 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.134836399000001, 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.349076098, 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185093+0000", 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999952 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185102+0000", 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185111+0000", 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4130000000000006e-06 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185116+0000", 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0080000000000002e-06 2024-09-18T10:31:50.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185151+0000", 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5216000000000003e-05 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185156+0000", 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5090000000000001e-06 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534040+0000", 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.34888328099999999 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534174+0000", 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134129 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T10:31:50.327 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.134922336999999, 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010537852, 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185009+0000", 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185021+0000", 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024e-05 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185062+0000", 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0363e-05 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185072+0000", 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0712e-05 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185133+0000", 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0458999999999998e-05 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185140+0000", 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1720000000000001e-06 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190251+0000", 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051104840000000002 2024-09-18T10:31:50.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190319+0000", 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8640999999999996e-05 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190422+0000", 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102576 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.191693+0000", 2024-09-18T10:31:50.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012707980000000001 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195487+0000", 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003794651 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195521+0000", 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3760999999999997e-05 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195550+0000", 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742e-05 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:199 3.fs0 3:f4795e34:::smithi16036501-42:head [append 0~655360] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.044052966999999, 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069400019999999998, 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.334 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 199 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275881+0000", 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.275880+0000", 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276765+0000", 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088549699999999996 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276778+0000", 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2252999999999999e-05 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276782+0000", 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2810000000000002e-06 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276813+0000", 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1058e-05 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.276874+0000", 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1088999999999997e-05 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.277608+0000", 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073422699999999995 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280017+0000", 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024085579999999999 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282781+0000", 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027636050000000001 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.282821+0000", 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0683999999999999e-05 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:200 3.fs0 3:f4795e34:::smithi16036501-42:head [append 0~376832] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.041910187999999, 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076441959999999998, 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 200 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278024+0000", 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278023+0000", 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278670+0000", 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064669399999999996 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278679+0000", 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4809999999999995e-06 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278683+0000", 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7900000000000001e-06 2024-09-18T10:31:50.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278710+0000", 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7151000000000001e-05 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278759+0000", 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8618000000000001e-05 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279167+0000", 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040784699999999997 2024-09-18T10:31:50.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280125+0000", 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095786999999999999 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285637+0000", 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055121420000000003 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285668+0000", 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1341999999999999e-05 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:201 3.fs0 3:f4795e34:::smithi16036501-42:head [setxattr _header (56) in=7b] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.041244847000002, 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071686570000000002, 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 201 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278689+0000", 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278692+0000", 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9440000000000001e-06 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278697+0000", 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6980000000000003e-06 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278700+0000", 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4789999999999999e-06 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279543+0000", 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084349999999999996 2024-09-18T10:31:50.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279615+0000", 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1477999999999996e-05 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.279853+0000", 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238106 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280169+0000", 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031569500000000001 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285808+0000", 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056395229999999996 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.285858+0000", 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9799000000000002e-05 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:202 3.fs0 3:f4795e34:::smithi16036501-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.041221072999999, 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081974649999999993, 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 202 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278715+0000", 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3609999999999999e-06 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278722+0000", 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5520000000000001e-06 2024-09-18T10:31:50.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278725+0000", 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-06 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280064+0000", 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013385389999999999 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280120+0000", 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5856999999999997e-05 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286097+0000", 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059775230000000002 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286178+0000", 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0519999999999995e-05 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286911+0000", 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073268499999999996 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:220 3.as0 3:5626e28a:::smithi16036501-35:head [rollback 4] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322058+0000", 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.997876368, 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073414489999999999, 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 220 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322058+0000", 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322058+0000", 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322056+0000", 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322064+0000", 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0899999999999999e-06 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322082+0000", 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8283000000000001e-05 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322088+0000", 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5300000000000002e-06 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323501+0000", 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001412684 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.323568+0000", 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6996999999999996e-05 2024-09-18T10:31:50.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324017+0000", 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044873500000000002 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.326408+0000", 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023910630000000001 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329365+0000", 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029574699999999998 2024-09-18T10:31:50.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329399+0000", 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.392e-05 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:221 3.as0 3:5626e28a:::smithi16036501-35:head [append 0~0] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.997836701000001, 2024-09-18T10:31:50.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073974669999999996, 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 221 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322097+0000", 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322103+0000", 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1430000000000003e-06 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322115+0000", 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.203e-05 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.322124+0000", 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1160000000000005e-06 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324327+0000", 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022027399999999999 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324403+0000", 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6731999999999996e-05 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.324763+0000", 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000359864 2024-09-18T10:31:50.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329244+0000", 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044813170000000003 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329465+0000", 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022025500000000001 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.329495+0000", 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0247e-05 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:278 3.as0 3:597221c7:::smithi16036501-40:head [create,setxattr dj[s][nsgcdlaO`ntnnogS`sZdZO[V\\]llWi\\gjj (11296) in=40b,setxattr qRNaVOjbUaQsk\\XsiZbOhrsOSoqX_Tqndtkb\\_Sa (1297) in=40b,setxattr `hdQPrsh[aUo`rPcbh\\tWT\\PatkS^p[P_Pdmcgdi (840) in=40b,setxattr RXicf\\^UcqO_mXh^am]mfcdttd\\mfOiPqZcomOo` (1822) in=40b,setxattr oZlXqWbdtOrc_U_m[apaV_Nr[hOOUgj`sVNpq^Rp (1473) in=40b,setxattr TrdTbcloOaiWXhjih\\mdXfYZcg\\^aOrnVOj^sf`s (10104) in=40b,setxattr XftrktNgjnZekN[]^ls\\[htgSaXkUrlVOqS[WcNt (1263) in=40b,setxattr ^qaVseQnk[`qOXVa`m]]NtQ\\psXaNYand^tQYrWt (1051) in=40b,setxattr b_e\\_i^rj`csr^q^\\e_boR\\lQNhcZg_NVqpgUQ`Q (418) in=40b,setxattr cfoPTk\\o\\Qqbi^XNOW[dbpcRb`OledY]YqcmmqUr (19016) in=40b,setxattr qjofnWtf]NipeS]\\gcjdaepnS_Pi^QgbRZd (10104) in=35b,setxattr mtVO^NRpeT]rQZYdTadneUO_^VXn^UdhZ^\\bUQiR (769) in=40b,setxattr prahkiNnm`U[rXSatop\\lk_p\\WVkdatg[XURZrsm (4560) in=40b,setxattr isZNUepUtPtRnYQaXpfelSVVR\\apSohRfqcfV`T_ (10033) in=40b,setxattr QZkproN[Zssrnra[rrbkaSXpatcreQpt`tWbOdoO (8349) in=40b,setxattr YqVPkaeiY^Tbe\\Rr\\heXkWjtOsi`iaN[TO\\^kP^] (876) in=40b,setxattr ZdfcZ]]snWVj]dZhZ]YSjVneRRoNbk`d^een^nqN (3368) in=40b,setxattr Y^XWcNfadqaYlbNpPbVRoPtgWreNtPrhWlfbbYY] (10804) in=40b,setxattr a`l_j\\^WlXY[ekSUURUhO (10104) in=21b,setxattr YgOToR[hPbQocWaoh\\h_NkYaghbpdean`\\kalgQ[ (1541) in=40b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.002003053999999, 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010663587, 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 278 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:31:50.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317930+0000", 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318130+0000", 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020014100000000001 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318141+0000", 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1308000000000001e-05 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318146+0000", 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318184+0000", 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8597000000000003e-05 2024-09-18T10:31:50.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318296+0000", 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111852 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319182+0000", 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088532300000000003 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.321095+0000", 2024-09-18T10:31:50.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001913131 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328552+0000", 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074568689999999997 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328595+0000", 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3090999999999998e-05 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:292 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.009151827, 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010659095, 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 292 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310780+0000", 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:50.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310799+0000", 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9327e-05 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310820+0000", 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0859000000000001e-05 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310829+0000", 2024-09-18T10:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9600000000000006e-06 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4290999999999999e-05 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310889+0000", 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1909999999999999e-06 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316357+0000", 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054682480000000002 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316408+0000", 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1192e-05 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.321441+0000", 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050333549999999998 2024-09-18T10:31:50.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:293 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.009093579000002, 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011301637999999999, 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.378 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 293 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310840+0000", 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310844+0000", 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2350000000000001e-06 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310854+0000", 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9340000000000001e-06 2024-09-18T10:31:50.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310859+0000", 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9869999999999999e-06 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310943+0000", 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3727999999999995e-05 2024-09-18T10:31:50.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310949+0000", 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1800000000000001e-06 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316672+0000", 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057234160000000003 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316761+0000", 2024-09-18T10:31:50.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8483e-05 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.322142+0000", 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053813089999999999 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:294 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:31:50.383 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.009050458000001, 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012181983, 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 294 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:31:50.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310886+0000", 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8210000000000002e-06 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310891+0000", 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6439999999999999e-06 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310897+0000", 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3040000000000001e-06 2024-09-18T10:31:50.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310968+0000", 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0729999999999995e-05 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310973+0000", 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.853e-06 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317866+0000", 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068931009999999996 2024-09-18T10:31:50.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317931+0000", 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5177000000000003e-05 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.323066+0000", 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051347789999999999 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:295 3.as0 3:597221c7:::smithi16036501-40:head [copy-from ver 12] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.009034332999999, 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021473249999999999, 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 295 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:31:50.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310909+0000", 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8190000000000003e-06 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310918+0000", 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0440000000000001e-06 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310923+0000", 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0430000000000001e-06 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310964+0000", 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1553e-05 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310971+0000", 2024-09-18T10:31:50.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6320000000000002e-06 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316320+0000", 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053496139999999999 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316416+0000", 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5945000000000004e-05 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324379+0000", 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079626609999999994 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329447+0000", 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050681579999999997 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332330+0000", 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028824720000000001 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332373+0000", 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3553000000000001e-05 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:296 3.as0 3:597221c7:::smithi16036501-40:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.009002220999999, 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01562151, 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.395 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 296 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310934+0000", 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7549999999999999e-06 2024-09-18T10:31:50.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310941+0000", 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5889999999999999e-06 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310946+0000", 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0259999999999998e-06 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310985+0000", 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8912000000000003e-05 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310988+0000", 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3469999999999999e-06 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316561+0000", 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055726819999999998 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316612+0000", 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0776000000000003e-05 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326337+0000", 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097256470000000005 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326429+0000", 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1984999999999994e-05 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326553+0000", 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012421900000000001 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:361 3.fs0 3:f96c479d:::smithi16036501-23:head [copy-from ver 4] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.726504496, 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014671442, 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 361 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:31:50.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593428+0000", 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593438+0000", 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8490000000000001e-06 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593456+0000", 2024-09-18T10:31:50.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8763999999999999e-05 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593464+0000", 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5469999999999999e-06 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593545+0000", 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0697000000000003e-05 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:50.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593554+0000", 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0529999999999996e-06 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595269+0000", 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017153100000000001 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595397+0000", 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012801800000000001 2024-09-18T10:31:50.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.602617+0000", 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072194609999999999 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607654+0000", 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005037489 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607731+0000", 2024-09-18T10:31:50.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7068000000000001e-05 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.608101+0000", 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037002600000000002 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:362 3.fs0 3:f96c479d:::smithi16036501-23:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.726455493, 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010278183999999999, 2024-09-18T10:31:50.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 362 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593478+0000", 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593482+0000", 2024-09-18T10:31:50.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4399999999999998e-06 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593553+0000", 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0816999999999996e-05 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593583+0000", 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9629999999999999e-05 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593637+0000", 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3905e-05 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593643+0000", 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8199999999999999e-06 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595814+0000", 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021701160000000001 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595866+0000", 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2797999999999998e-05 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603570+0000", 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00770355 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603661+0000", 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1476000000000003e-05 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603757+0000", 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5461e-05 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.1s1 49/33 ECSubWrite(tid=169, reqid=osd.4.0:168, at_version=0'0, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.604332+0000", 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.715602225000001, 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076120789999999999, 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604332+0000", 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604332+0000", 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604331+0000", 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604345+0000", 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4235e-05 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604370+0000", 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4876999999999999e-05 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604378+0000", 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3069999999999997e-06 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604422+0000", 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4974e-05 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604432+0000", 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6479999999999998e-06 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.611919+0000", 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007486861 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.611944+0000", 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5037000000000001e-05 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.417 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.7s6 49/33 ECSubWrite(tid=170, reqid=osd.4.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.715544083000001, 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076710930000000004, 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604400+0000", 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0104e-05 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604410+0000", 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0101999999999999e-05 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604415+0000", 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3539999999999999e-06 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604790+0000", 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037486699999999997 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604798+0000", 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9759999999999995e-06 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612047+0000", 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072487979999999999 2024-09-18T10:31:50.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612061+0000", 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4395e-05 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:461 3.as0 3:52d3343a:::smithi16036501-18:head [delete] snapc 13=[d,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6795956889999992, 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01033507, 2024-09-18T10:31:50.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 461 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640336+0000", 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640345+0000", 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7749999999999998e-06 2024-09-18T10:31:50.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640361+0000", 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5313999999999999e-05 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640368+0000", 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2930000000000003e-06 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640442+0000", 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3814999999999997e-05 2024-09-18T10:31:50.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640450+0000", 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3380000000000005e-06 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642167+0000", 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001716845 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642262+0000", 2024-09-18T10:31:50.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5354999999999998e-05 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650674+0000", 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084114099999999994 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:495 3.ds0 3:b4dda727:::smithi16036501-2:head [rmxattr NaWdn]fbrYUmjb`RnlX[nf]flgaVPdYaRaTsjd[_ in=40b,rmxattr Ndldqgh]PmQiPQt]XYQlRPtUrpta^^g`PPlosidN in=40b,rmxattr Wa^Tke^bWpgZXViVjeiO\\StNeTlrVofZXm\\afTgO in=40b,rmxattr XgVjiYZ\\UlNjf[Xcgc]kanprjmmN`TtrhXZN[NkY in=40b,rmxattr cTrrZmiZ\\drosZ^RTmSgdbdZt]RcZ\\RfciroNfea in=40b,rmxattr f[[l\\`WWX_\\^aPb`TiUX]la^kd_VbfYa^ha^[c[] in=40b,rmxattr nqUnbTdiWZdmero]g_b_`efZ\\^aTmXoU]\\Qfcao_ in=40b] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7209677780000003, 2024-09-18T10:31:50.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010734373, 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 495 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598964+0000", 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598976+0000", 2024-09-18T10:31:50.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2475e-05 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598996+0000", 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9901000000000001e-05 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599003+0000", 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0280000000000003e-06 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599063+0000", 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9731000000000001e-05 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599069+0000", 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2979999999999997e-06 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.600844+0000", 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001774767 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.600924+0000", 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9864999999999995e-05 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601669+0000", 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074501199999999997 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604092+0000", 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002423138 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609644+0000", 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055519419999999998 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609701+0000", 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6937000000000001e-05 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:50.434 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:50.434 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:50.435 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:50.436 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:50.434+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:50.536 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:50.534+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:50.545 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:50.545 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:50.545 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:50.545 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:50.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:50.637 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:50.635+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:50.655 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:50.655 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:50.655 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:50.655 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:50.655 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:50.661 INFO:tasks.rados.rados.0.smithi160.stdout:211: done (1 left) 2024-09-18T10:31:50.661 INFO:tasks.rados.rados.0.smithi160.stdout:212: snap_create 2024-09-18T10:31:50.661 INFO:tasks.rados.rados.0.smithi160.stdout:210: finishing copy_from racing read to smithi16036501-12 2024-09-18T10:31:50.661 INFO:tasks.rados.rados.0.smithi160.stdout:210: finishing copy_from to smithi16036501-12 2024-09-18T10:31:50.661 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 12 v 35 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-18T10:31:50.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:50.738 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:50.736+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:50.766 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:50.767 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:50.767 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:50.767 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:50.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.767 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 40/33 ECSubWrite(tid=38, reqid=osd.0.0:38, at_version=40'27, trim_to=0'0, roll_forward_to=39'25))", 2024-09-18T10:31:50.768 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:25.293708+0000", 2024-09-18T10:31:50.768 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.470353529, 2024-09-18T10:31:50.768 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00441816, 2024-09-18T10:31:50.768 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.768 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.769 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.769 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.769 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293708+0000", 2024-09-18T10:31:50.769 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.770 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.770 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293708+0000", 2024-09-18T10:31:50.770 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.771 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.771 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293707+0000", 2024-09-18T10:31:50.771 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.772 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.772 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293728+0000", 2024-09-18T10:31:50.772 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0373e-05 2024-09-18T10:31:50.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.772 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.773 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.773 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293740+0000", 2024-09-18T10:31:50.773 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2509e-05 2024-09-18T10:31:50.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.773 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.773 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.774 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293747+0000", 2024-09-18T10:31:50.774 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2199999999999997e-06 2024-09-18T10:31:50.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.774 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.774 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.775 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293800+0000", 2024-09-18T10:31:50.775 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3677999999999997e-05 2024-09-18T10:31:50.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.775 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.775 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.775 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.293809+0000", 2024-09-18T10:31:50.776 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:31:50.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.776 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.776 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.776 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298101+0000", 2024-09-18T10:31:50.777 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004291726 2024-09-18T10:31:50.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.777 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.777 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.777 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:25.298126+0000", 2024-09-18T10:31:50.778 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4720999999999999e-05 2024-09-18T10:31:50.778 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.778 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.778 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.778 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.450571401000001, 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064675760000000001, 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.779 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313489+0000", 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313515+0000", 2024-09-18T10:31:50.780 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6261000000000001e-05 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313533+0000", 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7538e-05 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.781 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313542+0000", 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4509999999999998e-06 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313600+0000", 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7883999999999997e-05 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313610+0000", 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7319999999999993e-06 2024-09-18T10:31:50.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319944+0000", 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063339829999999996 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319957+0000", 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.783 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 44/33 ECSubWrite(tid=28, reqid=osd.3.0:28, at_version=44'18, trim_to=0'0, roll_forward_to=42'16))", 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314923+0000", 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.449138219999998, 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050089790000000002, 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314923+0000", 2024-09-18T10:31:50.784 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314923+0000", 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314922+0000", 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.785 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314952+0000", 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9675e-05 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314983+0000", 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0766999999999999e-05 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314990+0000", 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1609999999999997e-06 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.786 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315075+0000", 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5302000000000004e-05 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315086+0000", 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0628999999999999e-05 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319898+0000", 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004811727 2024-09-18T10:31:50.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319932+0000", 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4223000000000001e-05 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=47, reqid=osd.0.0:46, at_version=0'0, trim_to=0'0, roll_forward_to=44'39))", 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.325962+0000", 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.438099008000002, 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053078630000000003, 2024-09-18T10:31:50.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325962+0000", 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325962+0000", 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325961+0000", 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325973+0000", 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2e-05 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325989+0000", 2024-09-18T10:31:50.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.524e-05 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325996+0000", 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2169999999999997e-06 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326066+0000", 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9927999999999999e-05 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326079+0000", 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3774000000000001e-05 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331238+0000", 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.005158139 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331270+0000", 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2407999999999999e-05 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.792 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 44/33 ECSubWrite(tid=22, reqid=osd.8.0:21, at_version=0'0, trim_to=0'0, roll_forward_to=44'12))", 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.326358+0000", 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.437703634000002, 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048685600000000001, 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326358+0000", 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326358+0000", 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326357+0000", 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326380+0000", 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3206000000000001e-05 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326394+0000", 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3871e-05 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326401+0000", 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1069999999999999e-06 2024-09-18T10:31:50.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326447+0000", 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6272e-05 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.326456+0000", 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2099999999999999e-06 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331196+0000", 2024-09-18T10:31:50.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047391129999999997 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.331226+0000", 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0593999999999999e-05 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/33 ECSubWrite(tid=53, reqid=client.4589.0:299, at_version=45'45, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:31:50.797 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 20.435651814, 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056329550000000003, 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328408+0000", 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328607+0000", 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00019832300000000001 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328623+0000", 2024-09-18T10:31:50.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6240999999999999e-05 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328633+0000", 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0015e-05 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328719+0000", 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.6198000000000004e-05 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328731+0000", 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2055000000000001e-05 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334030+0000", 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052983739999999998 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334042+0000", 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2646999999999999e-05 2024-09-18T10:31:50.801 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/33 ECSubWrite(tid=54, reqid=client.4589.0:300, at_version=45'46, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.329668+0000", 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 20.434393110999999, 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043831139999999996, 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329668+0000", 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329668+0000", 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329667+0000", 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329691+0000", 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4159e-05 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329703+0000", 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1834000000000001e-05 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329712+0000", 2024-09-18T10:31:50.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4759999999999998e-06 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329754+0000", 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2522999999999999e-05 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.329762+0000", 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7570000000000004e-06 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334045+0000", 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042831620000000001 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334051+0000", 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0449999999999997e-06 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.806 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 49/33 ECSubWrite(tid=30, reqid=osd.8.0:30, at_version=49'22, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:33.597124+0000", 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 17.166936870000001, 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044972470000000002, 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597124+0000", 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597124+0000", 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597123+0000", 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597150+0000", 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.707e-05 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597170+0000", 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9548e-05 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597177+0000", 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4529999999999996e-06 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597252+0000", 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4309999999999998e-05 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.597264+0000", 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2369e-05 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601605+0000", 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043415499999999996 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:33.601622+0000", 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6107999999999999e-05 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 55/33 ECSubWrite(tid=55, reqid=osd.3.0:55, at_version=55'44, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.656680+0000", 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 11.107381416000001, 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044938809999999999, 2024-09-18T10:31:50.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656680+0000", 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656680+0000", 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656679+0000", 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656710+0000", 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1544000000000002e-05 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656730+0000", 2024-09-18T10:31:50.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9364e-05 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656738+0000", 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7260000000000002e-06 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656781+0000", 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3291000000000003e-05 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.814 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.656790+0000", 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5019999999999998e-06 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.661148+0000", 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043573559999999997 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.661174+0000", 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5993999999999999e-05 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.815 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 56/33 ECSubWrite(tid=62, reqid=osd.3.0:62, at_version=56'51, trim_to=0'0, roll_forward_to=55'47))", 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:40.635394+0000", 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.128667200000001, 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045475189999999999, 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635394+0000", 2024-09-18T10:31:50.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635394+0000", 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635393+0000", 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635421+0000", 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7611999999999999e-05 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635434+0000", 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3579e-05 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635441+0000", 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1659999999999997e-06 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635609+0000", 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00016783999999999999 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.635622+0000", 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2480000000000001e-05 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.639909+0000", 2024-09-18T10:31:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042873390000000003 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:40.639942+0000", 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2592000000000002e-05 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=72, reqid=osd.3.0:72, at_version=60'60, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:31:50.820 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1606781059999998, 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058652940000000001, 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:31:50.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603404+0000", 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1523e-05 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603416+0000", 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1263999999999999e-05 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603424+0000", 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0420000000000003e-06 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603495+0000", 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1149999999999995e-05 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603505+0000", 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8579999999999995e-06 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609223+0000", 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057186440000000002 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609248+0000", 2024-09-18T10:31:50.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5168999999999999e-05 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=73, reqid=osd.3.0:73, at_version=60'62, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1596924230000001, 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058440569999999997, 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604368+0000", 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604387+0000", 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9375999999999999e-05 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604401+0000", 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3591000000000001e-05 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604407+0000", 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7379999999999999e-06 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604451+0000", 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4082999999999998e-05 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604460+0000", 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3500000000000003e-06 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610197+0000", 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057371849999999997 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610213+0000", 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5522000000000001e-05 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.829 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 60/33 ECSubWrite(tid=55, reqid=osd.8.0:55, at_version=60'46, trim_to=0'0, roll_forward_to=59'44))", 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1594507749999998, 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055771479999999997, 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.830 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604628+0000", 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7564999999999999e-05 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604639+0000", 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604645+0000", 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.083e-06 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604699+0000", 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3789000000000003e-05 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604708+0000", 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4259999999999992e-06 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610156+0000", 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054475610000000001 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610188+0000", 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1924999999999997e-05 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.833 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/33 ECSubWrite(tid=133, reqid=osd.13.0:133, at_version=60'58, trim_to=0'0, roll_forward_to=56'56))", 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.608015+0000", 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1560465200000003, 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045706159999999996, 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608015+0000", 2024-09-18T10:31:50.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608015+0000", 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608015+0000", 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608031+0000", 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6646e-05 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608039+0000", 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6639999999999998e-06 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608043+0000", 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1010000000000002e-06 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608082+0000", 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8911000000000001e-05 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608089+0000", 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9870000000000002e-06 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612564+0000", 2024-09-18T10:31:50.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044755560000000003 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612585+0000", 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0907000000000002e-05 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=75, reqid=osd.3.0:75, at_version=60'64, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.613811+0000", 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1502500920000003, 2024-09-18T10:31:50.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048441680000000003, 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613811+0000", 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613811+0000", 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613811+0000", 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613825+0000", 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4082e-05 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613834+0000", 2024-09-18T10:31:50.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.6590000000000002e-06 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613838+0000", 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0679999999999998e-06 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613872+0000", 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3717000000000003e-05 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613878+0000", 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.4300000000000003e-06 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618631+0000", 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047526160000000003 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618655+0000", 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4168e-05 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.842 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/33 ECSubWrite(tid=136, reqid=osd.13.0:134, at_version=0'0, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.618523+0000", 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1455376990000001, 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050538700000000002, 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618523+0000", 2024-09-18T10:31:50.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618523+0000", 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618523+0000", 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618541+0000", 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8371000000000001e-05 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618551+0000", 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0251999999999999e-05 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618557+0000", 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6350000000000003e-06 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618647+0000", 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9839999999999994e-05 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618658+0000", 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0917999999999999e-05 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623552+0000", 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048941150000000001 2024-09-18T10:31:50.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623577+0000", 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5513000000000001e-05 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/33 ECSubWrite(tid=137, reqid=osd.13.0:137, at_version=60'62, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619164+0000", 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1448973100000002, 2024-09-18T10:31:50.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044268069999999996, 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619164+0000", 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619164+0000", 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619163+0000", 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619188+0000", 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4349999999999999e-05 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619202+0000", 2024-09-18T10:31:50.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4131000000000001e-05 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619208+0000", 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2600000000000002e-06 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619249+0000", 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0942999999999997e-05 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619259+0000", 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0088000000000001e-05 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623580+0000", 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043214919999999997 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623591+0000", 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0243e-05 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.851 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/33 ECSubWrite(tid=138, reqid=osd.13.0:138, at_version=60'64, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1440984649999999, 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0087157520000000002, 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619962+0000", 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619982+0000", 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9661e-05 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619994+0000", 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.205e-05 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620000+0000", 2024-09-18T10:31:50.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8100000000000003e-06 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620036+0000", 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6171000000000003e-05 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620042+0000", 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8560000000000003e-06 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628654+0000", 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0086122119999999993 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628678+0000", 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4586000000000001e-05 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=76, reqid=osd.3.0:75, at_version=0'0, trim_to=0'0, roll_forward_to=60'64))", 2024-09-18T10:31:50.856 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 6.1419471489999999, 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065928169999999999, 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:31:50.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622113+0000", 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622124+0000", 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1199999999999999e-05 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622137+0000", 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2866e-05 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622145+0000", 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2560000000000002e-06 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622196+0000", 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0878000000000003e-05 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622207+0000", 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.11e-05 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628685+0000", 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064776080000000002 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628707+0000", 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1889999999999999e-05 2024-09-18T10:31:50.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 61/33 ECSubWrite(tid=78, reqid=client.4589.0:499, at_version=61'56, trim_to=0'0, roll_forward_to=61'53))", 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:45.611926+0000", 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 5.152135489, 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004380086, 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:50.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.611926+0000", 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.611926+0000", 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.611925+0000", 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.862 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.612284+0000", 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00035860200000000002 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.612294+0000", 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0723999999999999e-05 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.612299+0000", 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1359999999999999e-06 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.612340+0000", 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1557999999999998e-05 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.612352+0000", 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1590000000000001e-05 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.616282+0000", 2024-09-18T10:31:50.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039304810000000004 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:45.616306+0000", 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3584999999999999e-05 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:50.865 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:50.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:50.867 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:50.865+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:50.964 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:50.964 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:50.965 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:50.965 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:50.967 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:50.966+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:50.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:51.069 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:51.068+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:51.071 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:51.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:51.071 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:51.071 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:51.071 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:51.080 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:51.170 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:51.169+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.221 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 49.157167655999999, 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76442072000000005, 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:51.222 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060653+0000", 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.223 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060661+0000", 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4030000000000007e-06 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060672+0000", 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060691+0000", 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8553e-05 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.225 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.225 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060740+0000", 2024-09-18T10:31:51.225 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:31:51.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060747+0000", 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1399999999999997e-06 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.823811+0000", 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76306395100000002 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.226 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824007+0000", 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000196737 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824158+0000", 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000150913 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824701+0000", 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054279800000000004 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.227 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825007+0000", 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030596600000000002 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825044+0000", 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6853000000000001e-05 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825075+0000", 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1102000000000001e-05 2024-09-18T10:31:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.222375769999999, 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089361909999999996, 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 47 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.230 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995550+0000", 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000104314 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.231 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995559+0000", 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7069999999999998e-06 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995568+0000", 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1479999999999995e-06 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999298+0000", 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037306729999999999 2024-09-18T10:31:51.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999379+0000", 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0304999999999998e-05 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999486+0000", 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010773299999999999 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001630+0000", 2024-09-18T10:31:51.233 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021436200000000002 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004321+0000", 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0026907049999999998 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004355+0000", 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4591000000000001e-05 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.234 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004382+0000", 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6869999999999999e-05 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.222245614999999, 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089031370000000002, 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.235 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 48 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.236 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995576+0000", 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995580+0000", 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.532e-06 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995586+0000", 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8989999999999998e-06 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995590+0000", 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9099999999999998e-06 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999825+0000", 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042355350000000003 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999877+0000", 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1273999999999997e-05 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999957+0000", 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0098000000000005e-05 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001636+0000", 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016796300000000001 2024-09-18T10:31:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004425+0000", 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0027888000000000001 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004456+0000", 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0681e-05 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004479+0000", 2024-09-18T10:31:51.240 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3405999999999999e-05 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.222226509000002, 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089699740000000003, 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.241 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 49 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.243 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995598+0000", 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.495e-06 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995604+0000", 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4160000000000003e-06 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995607+0000", 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.439e-06 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.244 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000235+0000", 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046279570000000003 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000284+0000", 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8316000000000003e-05 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000364+0000", 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0117999999999994e-05 2024-09-18T10:31:51.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002075+0000", 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001711064 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004511+0000", 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024360699999999998 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004542+0000", 2024-09-18T10:31:51.246 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0998999999999999e-05 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004565+0000", 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3458000000000001e-05 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.222209257999999, 2024-09-18T10:31:51.247 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011464667, 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 50 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995612+0000", 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995711+0000", 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8493999999999996e-05 2024-09-18T10:31:51.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995719+0000", 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4160000000000004e-06 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995724+0000", 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000646+0000", 2024-09-18T10:31:51.250 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049220560000000002 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000740+0000", 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4660999999999994e-05 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000883+0000", 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00014210199999999999 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.251 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002077+0000", 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011947150000000001 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007015+0000", 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049376560000000003 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007053+0000", 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8469e-05 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007077+0000", 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3876999999999999e-05 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.222090827999999, 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011450287999999999, 2024-09-18T10:31:51.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 51 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.254 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995730+0000", 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.255 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995735+0000", 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.938e-06 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995741+0000", 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995744+0000", 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2729999999999998e-06 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001284+0000", 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00553982 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001354+0000", 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9439999999999999e-05 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001433+0000", 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9839000000000006e-05 2024-09-18T10:31:51.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002242+0000", 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080809000000000002 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007122+0000", 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004880428 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007150+0000", 2024-09-18T10:31:51.258 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8309999999999998e-05 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007181+0000", 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1059000000000002e-05 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.222072427000001, 2024-09-18T10:31:51.259 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011502327, 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 52 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995754+0000", 2024-09-18T10:31:51.261 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1610000000000002e-06 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995760+0000", 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995764+0000", 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6739999999999999e-06 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.262 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001659+0000", 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058952459999999998 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001742+0000", 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2378000000000003e-05 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001835+0000", 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3710999999999998e-05 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.263 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002405+0000", 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056997199999999997 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007206+0000", 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048005959999999999 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007231+0000", 2024-09-18T10:31:51.264 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5449999999999999e-05 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007252+0000", 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0319e-05 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.087962916999999, 2024-09-18T10:31:51.265 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010184168, 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 71 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.266 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129861+0000", 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1019999999999999e-06 2024-09-18T10:31:51.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129864+0000", 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.898e-06 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129866+0000", 2024-09-18T10:31:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0339999999999999e-06 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133579+0000", 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037133029999999998 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133627+0000", 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7700000000000001e-05 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133711+0000", 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3752999999999996e-05 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136265+0000", 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025542759999999999 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.139993+0000", 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003728543 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140023+0000", 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0103999999999998e-05 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140043+0000", 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.087953540999997, 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286735, 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 72 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129937+0000", 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8833999999999999e-05 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129943+0000", 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6710000000000004e-06 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129946+0000", 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2480000000000001e-06 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133930+0000", 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039838319999999997 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133979+0000", 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9802999999999997e-05 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134057+0000", 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7226999999999998e-05 2024-09-18T10:31:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136267+0000", 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022104440000000002 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140087+0000", 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038197069999999999 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140117+0000", 2024-09-18T10:31:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0156000000000001e-05 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140155+0000", 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8019000000000003e-05 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.087871835000001, 2024-09-18T10:31:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286248, 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 73 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129952+0000", 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7420000000000002e-06 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129956+0000", 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0289999999999999e-06 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129959+0000", 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134509+0000", 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045500389999999996 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134554+0000", 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4984999999999997e-05 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134633+0000", 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8549999999999998e-05 2024-09-18T10:31:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136269+0000", 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016365489999999999 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140192+0000", 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039229299999999998 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140217+0000", 2024-09-18T10:31:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4992000000000001e-05 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140236+0000", 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.895e-05 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.087837000999997, 2024-09-18T10:31:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010335796, 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 74 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129984+0000", 2024-09-18T10:31:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129989+0000", 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5680000000000001e-06 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129995+0000", 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3350000000000003e-06 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.286 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129999+0000", 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9500000000000003e-06 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134856+0000", 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048568020000000003 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134907+0000", 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1450999999999999e-05 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.287 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134984+0000", 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6379999999999997e-05 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136272+0000", 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012878449999999999 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140264+0000", 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039928409999999996 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140289+0000", 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4652999999999999e-05 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140321+0000", 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1550000000000001e-05 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.289 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.087808600999999, 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.01270772, 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 75 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.290 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.291 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130094+0000", 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1198000000000004e-05 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130104+0000", 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5789999999999993e-06 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130114+0000", 2024-09-18T10:31:51.292 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0808000000000001e-05 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135231+0000", 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051164119999999999 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135281+0000", 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0305e-05 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.293 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135363+0000", 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2083999999999995e-05 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136275+0000", 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091162199999999995 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142660+0000", 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063848919999999997 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.294 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142698+0000", 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8804999999999999e-05 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142721+0000", 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2498e-05 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.295 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 48.087699804000003, 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.015446817, 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 76 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.296 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130121+0000", 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.297 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130128+0000", 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.161e-06 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130135+0000", 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8189999999999992e-06 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130139+0000", 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7340000000000002e-06 2024-09-18T10:31:51.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135853+0000", 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057137840000000004 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135902+0000", 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9461e-05 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135979+0000", 2024-09-18T10:31:51.299 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6268999999999998e-05 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136467+0000", 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048846600000000001 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145517+0000", 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0090497459999999991 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.300 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145546+0000", 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9295999999999999e-05 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145569+0000", 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2697e-05 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:96 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.301 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.951950578999998, 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083996039999999998, 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 96 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.302 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265871+0000", 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.303 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265918+0000", 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7209999999999997e-05 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265925+0000", 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9569999999999996e-06 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.265928+0000", 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5429999999999998e-06 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.304 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268734+0000", 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028057780000000001 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268778+0000", 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3547000000000002e-05 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.268845+0000", 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7162999999999994e-05 2024-09-18T10:31:51.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.271236+0000", 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023913910000000001 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274205+0000", 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0029687939999999999 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.306 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274241+0000", 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6041000000000003e-05 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274271+0000", 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9798000000000002e-05 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.307 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.951693337999998, 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083081249999999995, 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.308 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 99 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266129+0000", 2024-09-18T10:31:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266128+0000", 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266201+0000", 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2515999999999995e-05 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.310 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266205+0000", 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8130000000000003e-06 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.266209+0000", 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5389999999999999e-06 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270099+0000", 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038896099999999999 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.311 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270142+0000", 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3142999999999997e-05 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.270209+0000", 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.737e-05 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.272000+0000", 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001790795 2024-09-18T10:31:51.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274386+0000", 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023865639999999999 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.313 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274407+0000", 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0856000000000002e-05 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.274437+0000", 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9298999999999998e-05 2024-09-18T10:31:51.316 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.317 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.317 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.317 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.317 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.318 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:51.318 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.823379713999998, 2024-09-18T10:31:51.318 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091240130000000003, 2024-09-18T10:31:51.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.319 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.319 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.319 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.319 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 121 2024-09-18T10:31:51.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.320 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.320 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.320 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:51.320 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.321 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.321 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.321 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:51.321 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.322 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.322 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.322 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:31:51.322 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.323 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.323 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394445+0000", 2024-09-18T10:31:51.323 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.292e-06 2024-09-18T10:31:51.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.324 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.324 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.324 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394448+0000", 2024-09-18T10:31:51.324 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0819999999999999e-06 2024-09-18T10:31:51.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.325 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.325 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.326 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394450+0000", 2024-09-18T10:31:51.326 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9420000000000002e-06 2024-09-18T10:31:51.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.326 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.326 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.327 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399432+0000", 2024-09-18T10:31:51.327 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049813349999999999 2024-09-18T10:31:51.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.327 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.327 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.328 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399474+0000", 2024-09-18T10:31:51.328 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2061000000000003e-05 2024-09-18T10:31:51.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.328 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.328 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.329 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399540+0000", 2024-09-18T10:31:51.329 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6324999999999999e-05 2024-09-18T10:31:51.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.329 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.329 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.329 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403485+0000", 2024-09-18T10:31:51.330 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039450300000000004 2024-09-18T10:31:51.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.330 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.330 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.330 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403519+0000", 2024-09-18T10:31:51.331 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3794000000000002e-05 2024-09-18T10:31:51.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.331 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.331 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.331 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403547+0000", 2024-09-18T10:31:51.332 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8195999999999999e-05 2024-09-18T10:31:51.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.332 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.332 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.332 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403566+0000", 2024-09-18T10:31:51.333 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9236999999999999e-05 2024-09-18T10:31:51.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.333 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.333 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.334 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.334 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:51.334 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.823369225, 2024-09-18T10:31:51.334 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0092440720000000007, 2024-09-18T10:31:51.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.335 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.335 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.335 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.335 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.335 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 122 2024-09-18T10:31:51.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.336 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.336 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.336 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:51.337 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.337 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.337 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:31:51.338 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.338 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.338 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394452+0000", 2024-09-18T10:31:51.339 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:51.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.339 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.339 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.339 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394455+0000", 2024-09-18T10:31:51.339 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.728e-06 2024-09-18T10:31:51.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.340 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.340 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.340 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394460+0000", 2024-09-18T10:31:51.340 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1089999999999997e-06 2024-09-18T10:31:51.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.341 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.341 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.341 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394463+0000", 2024-09-18T10:31:51.341 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0939999999999999e-06 2024-09-18T10:31:51.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.342 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.342 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.342 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399744+0000", 2024-09-18T10:31:51.342 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052808059999999999 2024-09-18T10:31:51.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.343 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.343 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.343 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399814+0000", 2024-09-18T10:31:51.343 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9710999999999997e-05 2024-09-18T10:31:51.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.344 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.344 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.344 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399928+0000", 2024-09-18T10:31:51.344 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000113885 2024-09-18T10:31:51.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.345 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.345 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.345 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403609+0000", 2024-09-18T10:31:51.345 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036813979999999998 2024-09-18T10:31:51.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.346 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.346 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.346 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403616+0000", 2024-09-18T10:31:51.346 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7390000000000002e-06 2024-09-18T10:31:51.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.347 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.347 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.347 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403658+0000", 2024-09-18T10:31:51.347 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2373000000000002e-05 2024-09-18T10:31:51.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.348 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.348 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.348 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403697+0000", 2024-09-18T10:31:51.348 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8435e-05 2024-09-18T10:31:51.348 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.349 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.349 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.349 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.349 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.350 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:51.350 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.823346934, 2024-09-18T10:31:51.350 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011099146000000001, 2024-09-18T10:31:51.350 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.350 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.351 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.351 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.351 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 123 2024-09-18T10:31:51.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.352 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.352 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.352 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.352 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:51.352 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.353 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.353 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.353 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.353 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:51.353 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.354 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.354 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:31:51.354 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.355 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.355 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.355 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394505+0000", 2024-09-18T10:31:51.355 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0673999999999998e-05 2024-09-18T10:31:51.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.356 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.356 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.356 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394511+0000", 2024-09-18T10:31:51.357 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5539999999999997e-06 2024-09-18T10:31:51.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.357 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.357 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.357 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394513+0000", 2024-09-18T10:31:51.358 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.52e-06 2024-09-18T10:31:51.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.358 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.358 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.358 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400185+0000", 2024-09-18T10:31:51.359 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056715170000000001 2024-09-18T10:31:51.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.359 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.359 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.359 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400227+0000", 2024-09-18T10:31:51.360 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2512999999999998e-05 2024-09-18T10:31:51.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.360 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.360 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.360 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400322+0000", 2024-09-18T10:31:51.361 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4887000000000001e-05 2024-09-18T10:31:51.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.361 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.361 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.361 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403719+0000", 2024-09-18T10:31:51.361 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033967540000000001 2024-09-18T10:31:51.362 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.362 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.362 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.362 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405497+0000", 2024-09-18T10:31:51.362 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001778204 2024-09-18T10:31:51.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.363 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.363 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.363 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405542+0000", 2024-09-18T10:31:51.363 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4502000000000002e-05 2024-09-18T10:31:51.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.364 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.364 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.364 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405574+0000", 2024-09-18T10:31:51.364 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:31:51.365 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.365 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.365 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.365 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.365 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:31:51.366 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:51.366 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.823304778000001, 2024-09-18T10:31:51.366 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.016509943999999999, 2024-09-18T10:31:51.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.366 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:51.367 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:31:51.367 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:31:51.367 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:31:51.367 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 124 2024-09-18T10:31:51.367 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.368 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.368 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.368 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.368 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:51.368 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.369 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.369 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.369 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:51.369 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.370 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.370 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.370 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:31:51.370 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.370 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.371 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.371 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.371 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394519+0000", 2024-09-18T10:31:51.371 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.508e-06 2024-09-18T10:31:51.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.372 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.372 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.372 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394522+0000", 2024-09-18T10:31:51.372 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.83e-06 2024-09-18T10:31:51.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.373 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.373 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.373 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394524+0000", 2024-09-18T10:31:51.373 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.804e-06 2024-09-18T10:31:51.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.374 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.374 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.374 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403059+0000", 2024-09-18T10:31:51.374 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085345979999999991 2024-09-18T10:31:51.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.374 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.375 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:31:51.375 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403129+0000", 2024-09-18T10:31:51.375 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0043999999999995e-05 2024-09-18T10:31:51.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.375 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.376 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:31:51.376 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403245+0000", 2024-09-18T10:31:51.376 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000116123 2024-09-18T10:31:51.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.376 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.377 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:31:51.377 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.404743+0000", 2024-09-18T10:31:51.377 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001498309 2024-09-18T10:31:51.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.377 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.378 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:31:51.378 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410948+0000", 2024-09-18T10:31:51.378 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062045370000000004 2024-09-18T10:31:51.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.378 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:31:51.379 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410993+0000", 2024-09-18T10:31:51.379 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5629e-05 2024-09-18T10:31:51.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.379 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.380 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.411027+0000", 2024-09-18T10:31:51.380 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3827e-05 2024-09-18T10:31:51.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.380 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.381 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.381 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.es2 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:31:51.381 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:51.381 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.903495879000001, 2024-09-18T10:31:51.382 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083182759999999994, 2024-09-18T10:31:51.382 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.382 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.382 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.383 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.383 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:51.383 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.383 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.384 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.384 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:51.384 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.385 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.385 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.385 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314326+0000", 2024-09-18T10:31:51.385 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:51.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.386 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.386 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314351+0000", 2024-09-18T10:31:51.386 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4774999999999999e-05 2024-09-18T10:31:51.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.387 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.387 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.387 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314361+0000", 2024-09-18T10:31:51.387 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0353999999999999e-05 2024-09-18T10:31:51.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.388 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.388 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.388 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314368+0000", 2024-09-18T10:31:51.388 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.601e-06 2024-09-18T10:31:51.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.389 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.389 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.389 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314441+0000", 2024-09-18T10:31:51.389 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3112000000000001e-05 2024-09-18T10:31:51.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.389 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.390 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.390 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314450+0000", 2024-09-18T10:31:51.390 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2220000000000008e-06 2024-09-18T10:31:51.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.390 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.391 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.391 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322612+0000", 2024-09-18T10:31:51.391 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081619929999999993 2024-09-18T10:31:51.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.391 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.392 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.392 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322644+0000", 2024-09-18T10:31:51.392 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2419999999999998e-05 2024-09-18T10:31:51.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.392 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.393 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.393 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:51.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:51.396 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:51.394+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:51.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:51.496 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:51.494+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:51.535 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:51.535 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:51.535 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:51.535 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:51.543 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:51.596 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:51.594+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:51.620 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:51.638 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:51.638 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:51.642 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:51.642 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:51.642 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:31:51.642 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:31:51.642 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:51.650 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:51.653 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:51.653 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:51.662 INFO:tasks.rados.rados.0.smithi160.stdout:210: done (1 left) 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:212: done (0 left) 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:213: rmattr oid 16 current snap is 16 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:213: done (0 left) 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:214: read oid 11 snap -1 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:214: expect deleted 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:215: read oid 16 snap -1 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:215: expect (ObjNum 90 snap 11 seq_num 90) 2024-09-18T10:31:51.663 INFO:tasks.rados.rados.0.smithi160.stdout:216: snap_create 2024-09-18T10:31:51.676 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:51.682 INFO:tasks.rados.rados.0.smithi160.stdout:215: expect (ObjNum 90 snap 11 seq_num 90) 2024-09-18T10:31:51.692 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:51.697 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:51.696+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:51.708 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:51.708 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:51.714 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:31:51.725 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:51.725 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:51.741 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:51.741 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:51.789 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:51.789 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:31:51.789 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:31:51.789 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:31:51.789 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.472881849, 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054360959999999996, 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:31:51.790 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314517+0000", 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.791 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314545+0000", 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7441e-05 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314558+0000", 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2716e-05 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314564+0000", 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7190000000000004e-06 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.792 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314614+0000", 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9595000000000002e-05 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314623+0000", 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9889999999999998e-06 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.793 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319931+0000", 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053084439999999998 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319954+0000", 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3073000000000001e-05 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:31:51.794 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.469905354000002, 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00557647, 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.795 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317494+0000", 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317507+0000", 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317522+0000", 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.45e-05 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.797 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317529+0000", 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4619999999999999e-06 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317587+0000", 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7552000000000001e-05 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317597+0000", 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8810000000000008e-06 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323054+0000", 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054572689999999998 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323071+0000", 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7435000000000002e-05 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.799 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 44/33 ECSubWrite(tid=21, reqid=osd.8.0:21, at_version=44'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 22.468131934999999, 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063338889999999997, 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.800 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319300+0000", 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1572000000000002e-05 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319313+0000", 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3832000000000001e-05 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319322+0000", 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1419999999999999e-06 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319384+0000", 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1598000000000002e-05 2024-09-18T10:31:51.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319394+0000", 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8079999999999999e-06 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325566+0000", 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006172192 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325602+0000", 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6075999999999998e-05 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=130, reqid=client.4589.0:310, at_version=45'32, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.448477871000001, 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050500179999999999, 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.804 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.805 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.338922+0000", 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339438+0000", 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051584199999999997 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339453+0000", 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5784999999999999e-05 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339461+0000", 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1349999999999992e-06 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339529+0000", 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7595999999999995e-05 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.807 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.339542+0000", 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2451e-05 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343951+0000", 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0044095979999999998 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.808 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343972+0000", 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1254e-05 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.446562265000001, 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054953399999999996, 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:31:51.810 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340837+0000", 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341640+0000", 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080260699999999999 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.811 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341653+0000", 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3579e-05 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341665+0000", 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1549000000000001e-05 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341728+0000", 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2787999999999996e-05 2024-09-18T10:31:51.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341738+0000", 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0380000000000001e-05 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346306+0000", 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045678009999999998 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.813 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346333+0000", 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7606999999999998e-05 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=132, reqid=client.4589.0:311, at_version=45'33, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.443670177000001, 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006336899, 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.814 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343729+0000", 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344271+0000", 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054216699999999997 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344284+0000", 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2551999999999999e-05 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.816 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344290+0000", 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5599999999999999e-06 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344376+0000", 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5834000000000005e-05 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344387+0000", 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0942e-05 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350040+0000", 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056529889999999998 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350067+0000", 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6857999999999999e-05 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:31:51.818 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.442071039999998, 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0074420069999999996, 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345328+0000", 2024-09-18T10:31:51.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345430+0000", 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010200399999999999 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345444+0000", 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3827e-05 2024-09-18T10:31:51.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345454+0000", 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5219999999999996e-06 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346383+0000", 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00092949799999999996 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346395+0000", 2024-09-18T10:31:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1858999999999999e-05 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352753+0000", 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063576789999999998 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352771+0000", 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8556999999999999e-05 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=134, reqid=client.4589.0:313, at_version=45'35, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.440924246000002, 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063042000000000003, 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.824 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346475+0000", 2024-09-18T10:31:51.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346495+0000", 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9876000000000001e-05 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346507+0000", 2024-09-18T10:31:51.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2407e-05 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346514+0000", 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7220000000000002e-06 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346794+0000", 2024-09-18T10:31:51.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00028027400000000001 2024-09-18T10:31:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346807+0000", 2024-09-18T10:31:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2388999999999999e-05 2024-09-18T10:31:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352774+0000", 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059673729999999998 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352780+0000", 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1279999999999996e-06 2024-09-18T10:31:51.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=135, reqid=client.4589.0:302, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 21.440188998, 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055314830000000002, 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347210+0000", 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347224+0000", 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3794e-05 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347239+0000", 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5313000000000001e-05 2024-09-18T10:31:51.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347246+0000", 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7700000000000004e-06 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347295+0000", 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8534e-05 2024-09-18T10:31:51.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347306+0000", 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1224e-05 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352720+0000", 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054135549999999996 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352743+0000", 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3156999999999999e-05 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 17.186295156, 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053213160000000004, 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:31:51.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601104+0000", 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601311+0000", 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000206684 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601324+0000", 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3562e-05 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601330+0000", 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3630000000000002e-06 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601373+0000", 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3516000000000001e-05 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601380+0000", 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6109999999999999e-06 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606405+0000", 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050246329999999997 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606426+0000", 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1841e-05 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.839 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 17.184912655000002, 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064992319999999998, 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602487+0000", 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602544+0000", 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7605000000000002e-05 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602559+0000", 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4873e-05 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602566+0000", 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0180000000000004e-06 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603204+0000", 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00063799400000000002 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603216+0000", 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1888e-05 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608951+0000", 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057352130000000003 2024-09-18T10:31:51.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608987+0000", 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5417000000000003e-05 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 17.183675278999999, 2024-09-18T10:31:51.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052845369999999997, 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603725+0000", 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603724+0000", 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603740+0000", 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.611e-05 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603753+0000", 2024-09-18T10:31:51.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2379e-05 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603760+0000", 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9920000000000001e-06 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603799+0000", 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9725000000000003e-05 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603806+0000", 2024-09-18T10:31:51.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2790000000000004e-06 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608992+0000", 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051865909999999999 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.609009+0000", 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7323e-05 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=195, reqid=client.4589.0:427, at_version=55'49, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 12.118523250000001, 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0073182050000000004, 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669388+0000", 2024-09-18T10:31:51.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051155899999999997 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669401+0000", 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2711000000000001e-05 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669409+0000", 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6580000000000002e-06 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669465+0000", 2024-09-18T10:31:51.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5994e-05 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669472+0000", 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.695e-06 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676164+0000", 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0066911820000000004 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676195+0000", 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1532000000000002e-05 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=196, reqid=client.4589.0:428, at_version=55'50, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 12.114526446999999, 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057749089999999999, 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.853 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672873+0000", 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673445+0000", 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00057173499999999997 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673456+0000", 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1579999999999999e-05 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673463+0000", 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7320000000000001e-06 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673504+0000", 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0636999999999997e-05 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673516+0000", 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2187e-05 2024-09-18T10:31:51.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678624+0000", 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051085599999999998 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678649+0000", 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4375999999999998e-05 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/33 ECSubWrite(tid=235, reqid=client.4589.0:489, at_version=60'35, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.602093+0000", 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 7.1853073969999999, 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051715390000000002, 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602093+0000", 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602093+0000", 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602093+0000", 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602110+0000", 2024-09-18T10:31:51.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7102999999999999e-05 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602117+0000", 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2559999999999996e-06 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602122+0000", 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6639999999999997e-06 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602603+0000", 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048182200000000002 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602613+0000", 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.6679999999999996e-06 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.607243+0000", 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046301839999999999 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.607264+0000", 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1089000000000001e-05 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/33 ECSubWrite(tid=236, reqid=client.4589.0:490, at_version=60'36, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.602129+0000", 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 7.1852715119999999, 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051488890000000002, 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.862 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602129+0000", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602129+0000", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602128+0000", 2024-09-18T10:31:51.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602150+0000", 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1373999999999999e-05 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602157+0000", 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0480000000000001e-06 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602163+0000", 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8680000000000004e-06 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602902+0000", 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00073878400000000003 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.602924+0000", 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1991e-05 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.607267+0000", 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0043439400000000001 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.607278+0000", 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0124e-05 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.866 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 60/33 ECSubWrite(tid=238, reqid=osd.4.0:238, at_version=60'64, trim_to=0'0, roll_forward_to=56'62))", 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604112+0000", 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 7.1832881110000004, 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052042369999999996, 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604112+0000", 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.867 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604112+0000", 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604111+0000", 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604131+0000", 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9111e-05 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604144+0000", 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3796e-05 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604150+0000", 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0939999999999996e-06 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604195+0000", 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4569e-05 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604205+0000", 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.9320000000000008e-06 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609294+0000", 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050890909999999996 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609316+0000", 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2251000000000001e-05 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/33 ECSubWrite(tid=55, reqid=osd.8.0:55, at_version=60'46, trim_to=0'0, roll_forward_to=59'44))", 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 7.1827240940000001, 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056724729999999999, 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.871 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604700+0000", 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4581999999999999e-05 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604710+0000", 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2399999999999996e-06 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.873 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604715+0000", 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5910000000000003e-06 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604763+0000", 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7939999999999998e-05 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604774+0000", 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0698e-05 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610328+0000", 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055546199999999997 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610349+0000", 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0162000000000001e-05 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/33 ECSubWrite(tid=57, reqid=osd.8.0:56, at_version=0'0, trim_to=0'0, roll_forward_to=60'48))", 2024-09-18T10:31:51.875 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 7.1705199989999997, 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064620900000000002, 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616879+0000", 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616892+0000", 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2843000000000001e-05 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616905+0000", 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3203e-05 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616911+0000", 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0589999999999999e-06 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616965+0000", 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4148999999999999e-05 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616972+0000", 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2589999999999997e-06 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623313+0000", 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063408750000000002 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623342+0000", 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9731999999999999e-05 2024-09-18T10:31:51.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 60/33 ECSubWrite(tid=246, reqid=osd.4.0:246, at_version=60'68, trim_to=0'0, roll_forward_to=60'66))", 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 7.1701043760000003, 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0061440729999999999, 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.880 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617295+0000", 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617317+0000", 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1696e-05 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617330+0000", 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3634e-05 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617337+0000", 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2859999999999996e-06 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617382+0000", 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4780000000000002e-05 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617392+0000", 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0261999999999999e-05 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623413+0000", 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006020928 2024-09-18T10:31:51.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623440+0000", 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7203e-05 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:31:51.884 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:51.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:51.886 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:51.884+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:51.958 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:51.958 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:51.974 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:51.975 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:51.984 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:31:51.984 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:31:51.985 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:31:51.985 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:31:51.986 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:51.984+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:51.989 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:51.990 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:51.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:52.005 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:52.005 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:52.020 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:52.020 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:52.036 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:52.036 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:52.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:52.050+0000 7f9dfaffd640 0 -- 172.21.15.63:0/507223641 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7f9dfc192840 msgr2=0x7f9dfc194c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:52.053 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:52.069 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:52.069 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:52.086 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:52.085+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:52.188 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:52.187+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:52.242 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.242 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.250 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:52.288 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:52.287+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:52.351 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.352 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.360 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:52.404 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:52.402+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:52.457 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.458 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.467 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:52.507 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:52.505+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:52.589 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:31:52.590 INFO:tasks.rados.rados.0.smithi160.stdout:214: done (2 left) 2024-09-18T10:31:52.590 INFO:tasks.rados.rados.0.smithi160.stdout:215: done (1 left) 2024-09-18T10:31:52.590 INFO:tasks.rados.rados.0.smithi160.stdout:216: done (0 left) 2024-09-18T10:31:52.590 INFO:tasks.rados.rados.0.smithi160.stdout:217: copy_from oid 12 from oid 33 current snap is 17 2024-09-18T10:31:52.590 INFO:tasks.rados.rados.0.smithi160.stdout:218: snap_remove snap 16 2024-09-18T10:31:52.590 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:52.589+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:52.605 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.605 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.614 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:52.691 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:52.690+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.721 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:52.792 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:52.790+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:52.819 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.819 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.827 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:52.893 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:52.891+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:52.964 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:52.965 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:52.973 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:52.994 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:52.992+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:53.071 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.072 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:53.125 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:53.123+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:53.180 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.181 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.189 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:53.230 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:53.228+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:53.297 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:53.295+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:53.328 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.328 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.336 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:31:53.398 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:53.397+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:53.474 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.474 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:31:53.526 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:53.524+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:53.580 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.580 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.589 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:31:53.596 INFO:tasks.rados.rados.0.smithi160.stdout:218: done (1 left) 2024-09-18T10:31:53.596 INFO:tasks.rados.rados.0.smithi160.stdout:219: delete oid 3 current snap is 17 2024-09-18T10:31:53.596 INFO:tasks.rados.rados.0.smithi160.stdout:217: finishing copy_from to smithi16036501-12 2024-09-18T10:31:53.596 INFO:tasks.rados.rados.0.smithi160.stdout:217: got expected ENOENT (src dne) 2024-09-18T10:31:53.596 INFO:tasks.rados.rados.0.smithi160.stdout:217: finishing copy_from racing read to smithi16036501-12 2024-09-18T10:31:53.599 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:53.598+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:53.602 INFO:tasks.rados.rados.0.smithi160.stdout:217: done (1 left) 2024-09-18T10:31:53.602 INFO:tasks.rados.rados.0.smithi160.stdout:219: done (0 left) 2024-09-18T10:31:53.602 INFO:tasks.rados.rados.0.smithi160.stdout:220: setattr oid 46 current snap is 17 2024-09-18T10:31:53.604 INFO:tasks.rados.rados.0.smithi160.stdout:221: snap_create 2024-09-18T10:31:53.607 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 46 v 49 (ObjNum 737 snap 0 seq_num 2912919472) dirty exists 2024-09-18T10:31:53.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:53.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:31:53.680 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-18T10:31:53.680 INFO:tasks.thrashosds.thrasher:Setting osd 9 primary_affinity to 0.022727 2024-09-18T10:31:53.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 0.02272663074740755 2024-09-18T10:31:53.695 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.695 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:53.725 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:53.724+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:53.801 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:53.800+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:53.836 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.836 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:53.901 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:53.899+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:53.947 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:53.947 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:53.956 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:54.002 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:54.001+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:54.057 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:54.058 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:54.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:31:54.081 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:54.103 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:54.102+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:54.169 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:54.169 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:54.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:31:54.204 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:54.203+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:54.230 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:54.230 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:54.247 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:54.247 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:54.263 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:54.263 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:54.279 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:54.279 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:54.281 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:54.282 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:54.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:31:54.294 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:54.306 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:54.304+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:54.311 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:54.311 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:54.327 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:54.328 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:54.344 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:54.344 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:54.359 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:54.359 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:54.375 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:54.376 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:54.391 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:54.392 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:54.396 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:54.396 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:302 3.1s0 3:8a576e44:::smithi16036501-20:head [copy-from ver 5] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.0664835, 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020457712999999999, 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.397 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 302 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326556+0000", 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326570+0000", 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3662999999999999e-05 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326585+0000", 2024-09-18T10:31:54.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5468000000000002e-05 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326593+0000", 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326667+0000", 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4306000000000003e-05 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1179999999999992e-06 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328239+0000", 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015644680000000001 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328381+0000", 2024-09-18T10:31:54.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014198999999999999 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340281+0000", 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011899197 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343588+0000", 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003307197 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346944+0000", 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033560090000000001 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347016+0000", 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.403 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:303 3.1s0 3:8a576e44:::smithi16036501-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.066434242, 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016629574000000001, 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 303 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326607+0000", 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326611+0000", 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0389999999999998e-06 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326620+0000", 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6039999999999999e-06 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326630+0000", 2024-09-18T10:31:54.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326734+0000", 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104131 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1168999999999999e-05 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328659+0000", 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018941400000000001 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5146999999999999e-05 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343012+0000", 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014297432000000001 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343114+0000", 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010218 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343237+0000", 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123347 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.409 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:306 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.066329581000002, 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014939928, 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 306 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326715+0000", 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7330000000000001e-06 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326724+0000", 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326728+0000", 2024-09-18T10:31:54.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0500000000000002e-06 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326892+0000", 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016359100000000001 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326897+0000", 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5670000000000002e-06 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331380+0000", 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044830549999999997 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331488+0000", 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108174 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341652+0000", 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163635000000001 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.414 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:310 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.059969949999999, 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011394362999999999, 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 310 2024-09-18T10:31:54.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333072+0000", 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333070+0000", 2024-09-18T10:31:54.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334438+0000", 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013686499999999999 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334455+0000", 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6719e-05 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334460+0000", 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2140000000000004e-06 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336102+0000", 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016417669999999999 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.336227+0000", 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000124669 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338547+0000", 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023200989999999999 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344211+0000", 2024-09-18T10:31:54.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056638610000000001 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344388+0000", 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017787200000000001 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344466+0000", 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7768999999999994e-05 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.421 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:311 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~622592] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.055973922, 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266834, 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.422 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 311 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337066+0000", 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338892+0000", 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268259999999999 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338908+0000", 2024-09-18T10:31:54.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5418999999999999e-05 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338972+0000", 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4393000000000005e-05 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341761+0000", 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002788633 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341937+0000", 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017614900000000001 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343074+0000", 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001136698 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346619+0000", 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035453020000000002 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350277+0000", 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036582979999999999 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350335+0000", 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.736e-05 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.427 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:312 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~147456] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.054056719999998, 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014117187999999999, 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 312 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.428 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338983+0000", 2024-09-18T10:31:54.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339142+0000", 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015861599999999999 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339155+0000", 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2816000000000001e-05 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339164+0000", 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1749999999999994e-06 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344524+0000", 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053596679999999997 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344614+0000", 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0613999999999997e-05 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345181+0000", 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056671599999999999 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346674+0000", 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00149266 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353034+0000", 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063603460000000002 2024-09-18T10:31:54.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353102+0000", 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8188000000000005e-05 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:313 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.053870027999999, 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014065207, 2024-09-18T10:31:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 313 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339171+0000", 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339175+0000", 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5129999999999998e-06 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339186+0000", 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339191+0000", 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1619999999999999e-06 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345694+0000", 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065030009999999996 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345792+0000", 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8045000000000001e-05 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346298+0000", 2024-09-18T10:31:54.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050656699999999998 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347147+0000", 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084835599999999998 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353189+0000", 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060422569999999997 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353237+0000", 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7890999999999999e-05 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:314 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.053845087999999, 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015236665999999999, 2024-09-18T10:31:54.439 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 314 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339196+0000", 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339199+0000", 2024-09-18T10:31:54.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8890000000000002e-06 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339206+0000", 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339214+0000", 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1189999999999999e-06 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346686+0000", 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074727989999999996 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346756+0000", 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9511000000000006e-05 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353571+0000", 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068155439999999998 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353677+0000", 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010571 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.354433+0000", 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075619700000000001 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:318 3.1s0 3:8ee00428:::smithi16036501-24:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.989106370999998, 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012368581, 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 318 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403935+0000", 2024-09-18T10:31:54.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403938+0000", 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9960000000000002e-06 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403945+0000", 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2089999999999999e-06 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.403948+0000", 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.712e-06 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407079+0000", 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031311490000000002 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.407164+0000", 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5321999999999994e-05 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.415143+0000", 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079786830000000003 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.415238+0000", 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4784999999999995e-05 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.416304+0000", 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001066223 2024-09-18T10:31:54.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:370 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~638976] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.797633846, 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015060278, 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.450 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 370 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595405+0000", 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596396+0000", 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099055699999999998 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596414+0000", 2024-09-18T10:31:54.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8655999999999999e-05 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596422+0000", 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596466+0000", 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4187000000000002e-05 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596471+0000", 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2310000000000004e-06 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598062+0000", 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015909850000000001 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598126+0000", 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4302999999999997e-05 2024-09-18T10:31:54.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598945+0000", 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081903900000000003 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610343+0000", 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011397243 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610417+0000", 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4027000000000001e-05 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610468+0000", 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1551999999999997e-05 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.456 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:371 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~622592] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.794076954000001, 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013192463, 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 371 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598963+0000", 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599585+0000", 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000621708 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599601+0000", 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512e-05 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599608+0000", 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599960+0000", 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035244900000000001 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600065+0000", 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010497600000000001 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600996+0000", 2024-09-18T10:31:54.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00093031500000000003 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612013+0000", 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011017020000000001 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612082+0000", 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8853e-05 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612157+0000", 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5618999999999995e-05 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:372 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~147456] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.793409273999998, 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012685169, 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.462 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 372 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:31:54.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599631+0000", 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599752+0000", 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121066 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599766+0000", 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3681e-05 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599774+0000", 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7810000000000005e-06 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601741+0000", 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019676609999999999 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601868+0000", 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012701100000000001 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602485+0000", 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061702700000000003 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612162+0000", 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096771410000000002 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612277+0000", 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114471 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612318+0000", 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0738000000000002e-05 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.467 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:373 3.bs0 3:d059b4f5:::smithi16036501-10:head [setxattr _header (56) in=7b] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.793261580999999, 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012671714000000001, 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 373 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:31:54.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599783+0000", 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8829999999999999e-06 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599791+0000", 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0169999999999996e-06 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599795+0000", 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7079999999999999e-06 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603165+0000", 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033702279999999999 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603279+0000", 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113522 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603726+0000", 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044729299999999997 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084374069999999992 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612407+0000", 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024380300000000001 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612452+0000", 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4453000000000003e-05 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:374 3.bs0 3:d059b4f5:::smithi16036501-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.793242433, 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014050109, 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.474 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 374 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599802+0000", 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9550000000000001e-06 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599808+0000", 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9689999999999999e-06 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599811+0000", 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6370000000000001e-06 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603965+0000", 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041538549999999997 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.604070+0000", 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104654 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612750+0000", 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086806729999999999 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612839+0000", 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8678999999999996e-05 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.613849+0000", 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010102519999999999 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:448 3.7s0 3:e76b4e45:::smithi16036501-14:head [rollback 6] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.665725845000001, 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011821109999999999, 2024-09-18T10:31:54.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 448 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727316+0000", 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727318+0000", 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1519999999999999e-06 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727323+0000", 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4070000000000001e-06 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727326+0000", 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.309e-06 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729869+0000", 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002542472 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729965+0000", 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6366000000000005e-05 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730484+0000", 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051885199999999999 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.738286+0000", 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007801896 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739074+0000", 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000788429 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739137+0000", 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2623e-05 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:449 3.7s0 3:e76b4e45:::smithi16036501-14:head [append 0~0] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.665711444999999, 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013587101000000001, 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 449 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:31:54.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727334+0000", 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727340+0000", 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6790000000000002e-06 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727349+0000", 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5289999999999997e-06 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737235+0000", 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098852860000000001 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737349+0000", 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114485 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737818+0000", 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046887099999999999 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739481+0000", 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016627129999999999 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740836+0000", 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013552600000000001 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740917+0000", 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1295e-05 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:483 3.bs0 3:d8962f31:::smithi16036501-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e59)", 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:43.611219+0000", 2024-09-18T10:31:54.491 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.781822413, 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012579369999999999, 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 483 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.611219+0000", 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.611219+0000", 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.611219+0000", 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.611221+0000", 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4700000000000001e-06 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.611227+0000", 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.066e-06 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.611231+0000", 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.782e-06 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.616095+0000", 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048635370000000002 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.616159+0000", 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3783999999999998e-05 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.621315+0000", 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051561910000000001 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.621396+0000", 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1407000000000002e-05 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:43.623799+0000", 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024026 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:489 3.1s0 3:86a5dc0f:::smithi16036501-49:head [rollback 17] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.595674+0000", 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7973675809999996, 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012678340999999999, 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 489 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595674+0000", 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595674+0000", 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595670+0000", 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999957 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595678+0000", 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9699999999999999e-06 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595685+0000", 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4039999999999998e-06 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595690+0000", 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.707e-06 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595776+0000", 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6272000000000003e-05 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595785+0000", 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2059999999999996e-06 2024-09-18T10:31:54.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598939+0000", 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031538460000000001 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599047+0000", 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108305 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599632+0000", 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000584469 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603015+0000", 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033828700000000001 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608278+0000", 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052630730000000001 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608353+0000", 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4721000000000005e-05 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:490 3.1s0 3:86a5dc0f:::smithi16036501-49:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7973445259999998, 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012816803999999999, 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.503 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 490 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595700+0000", 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.568e-06 2024-09-18T10:31:54.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595707+0000", 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5860000000000001e-06 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595711+0000", 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9720000000000003e-06 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595822+0000", 2024-09-18T10:31:54.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110819 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595830+0000", 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6910000000000003e-06 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600152+0000", 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043221630000000004 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600254+0000", 2024-09-18T10:31:54.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101945 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600730+0000", 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047567799999999999 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603018+0000", 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002287472 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608447+0000", 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054292159999999997 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608514+0000", 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7257999999999999e-05 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:552 3.7s0 3:e6324555:::smithi16036501-16:head [read 0~2850816,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67)", 2024-09-18T10:31:54.509 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:51.662658+0000", 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.73038348, 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011312406000000001, 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 552 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662658+0000", 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662658+0000", 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662658+0000", 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662660+0000", 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.624e-06 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662666+0000", 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.071e-06 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662669+0000", 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7390000000000001e-06 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662812+0000", 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014251800000000001 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.662820+0000", 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6729999999999992e-06 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.667356+0000", 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004535931 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.667460+0000", 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104384 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:51.673971+0000", 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065106820000000003 2024-09-18T10:31:54.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.515 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.515 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.515 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:54.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:31:54.517 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:54.517 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:54.518 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:54.518 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:54.518 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:54.518 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:54.519 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:54.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:54.455+0000 7fe91e53a640 0 -- 172.21.15.63:0/115586196 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7fe918196000 msgr2=0x7fe9181983e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:54.519 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:54.520 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:54.520 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:54.515+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:54.597 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.9 primary-affinity to 0.0227266 (814892) 2024-09-18T10:31:54.600 INFO:tasks.rados.rados.0.smithi160.stdout:220: done (1 left) 2024-09-18T10:31:54.600 INFO:tasks.rados.rados.0.smithi160.stdout:221: done (0 left) 2024-09-18T10:31:54.600 INFO:tasks.rados.rados.0.smithi160.stdout:222: snap_remove snap 17 2024-09-18T10:31:54.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T10:31:54.655 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:54.654+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:54.667 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:54.667 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:54.667 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:54.667 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:54.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:31:54.718 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:54.716+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:54.819 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:54.819 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:54.819 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:54.819 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:54.819 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:54.819 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:54.818+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:54.827 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:31:54.920 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:31:54.919+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:31:54.930 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:54.930 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:54.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:54.930 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:54.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:366 3.4s0 3:2e7558df:::smithi16036501-5:head [delete] snapc d=[d,b,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.334741193999999, 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095772340000000004, 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 366 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593485+0000", 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:54.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593493+0000", 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9000000000000006e-06 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593511+0000", 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8011000000000001e-05 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593517+0000", 2024-09-18T10:31:54.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.781e-06 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593607+0000", 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9117999999999996e-05 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593636+0000", 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9022000000000001e-05 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594774+0000", 2024-09-18T10:31:54.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001138376 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594884+0000", 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110449 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595595+0000", 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00071014400000000001 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.598115+0000", 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0025207670000000001 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602981+0000", 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048657020000000004 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.603064+0000", 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2763999999999996e-05 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:367 3.4s0 3:22c8281c:::smithi16036501-32:head [create,setxattr nWX_d[W\\dXUWOgbXndrSbcTU`mgjR_]o\\nNcXpin (1403) in=40b,setxattr TSP[ddnm_WR]nh]QhSXpkpmmWeOP^b]baemT^Uqr (630) in=40b,setxattr R[QU^NWYrjfarmhlWmZlUkP\\ipWan`SnqZOX`VWh (806) in=40b,setxattr ]hV\\^[PQZO]n^abhilRfldoUhgtl\\\\oel`mgahd_ (3368) in=40b,setxattr OYc`XQ\\VjZfQ`]OsbemUo_mfVUSc^pNo\\[\\ldrhg (1087) in=40b,setxattr `pZtTmno_eqZOONfatgZ_`nnhemaaQWiteO]dc[V (175) in=40b,setxattr PdQa`feQapkrnjfOUYUeqsOt_hrsg\\noqrcV]pSh (981) in=40b,setxattr bk_QpaSsdlQfT`oa[pTQS_[ad]isfYm^tQNdhSiW (1718) in=40b,setxattr Ys`Y_UZ^PXhpgS`VS]`eVgkcmT^QW[aWscssRRSr (10033) in=40b,setxattr [jd]Q\\qemWTVcc`hiZnsrqrggetajZRa]\\_llS`h (1367) in=40b,setxattr `UajoeZh]tRSf\\[nnVat^TjN^_q`ooQ_br`itgZm (244) in=40b,setxattr Tng[WcWa_dsnRXtZNa^`fle`gQ___mar\\fgRsZVY (665) in=40b,setxattr nogmhepVZfQtnZc^cZSeaaogjklZkrff_Utg`UR^ (15856) in=40b,setxattr gfqSsQY[][rrac[gmaQrTSacNWttTTXhanmRa^fa (1998) in=40b,setxattr V`Y[ddb`_dfep[_]oUoTqQj\\UW[gkesnlgNPYtPa (1438) in=40b,setxattr YgoRVqUOj_mXPXsq^PdjaaolmQsTsTsZpaddktl[ (1400) in=40b,setxattr smn[QVPVkfVs]oTip]jtirOtU\\Pa\\Ym^poZgfZaq (1263) in=40b,setxattr TQSmSs^Z]\\rdosO_a^TOU^[p`jkQb`dXXh]s`Stq (909) in=40b,setxattr faPhpqVXmWh`VeNZo[b^[kYl^[[rYYPRrk_[ON`e (14664) in=40b,setxattr ksO_UmqqQefe[Q\\njt[W_roWeei`]Sn^TV]O^iSW (1963) in=40b] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.322092136999999, 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068636369999999997, 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:54.937 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 367 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:31:54.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606134+0000", 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606259+0000", 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012537799999999999 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606277+0000", 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7677e-05 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606284+0000", 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1629999999999999e-06 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606326+0000", 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1956000000000003e-05 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606462+0000", 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136422 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607463+0000", 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010009730000000001 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.609207+0000", 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017437399999999999 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612922+0000", 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003715281 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612999+0000", 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6951000000000002e-05 2024-09-18T10:31:54.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.321277648999999, 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048843690000000004, 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606949+0000", 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606978+0000", 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9088e-05 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606991+0000", 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.254e-05 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606997+0000", 2024-09-18T10:31:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999999e-06 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608218+0000", 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001220687 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608228+0000", 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0509999999999999e-05 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611809+0000", 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035805440000000002 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611834+0000", 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5670999999999999e-05 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.201658807999999, 2024-09-18T10:31:54.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049878819999999999, 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726568+0000", 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726971+0000", 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040273199999999999 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727008+0000", 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7058999999999999e-05 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727018+0000", 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4960000000000002e-06 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727105+0000", 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7641999999999999e-05 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727116+0000", 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0288e-05 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731541+0000", 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044253809999999999 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731557+0000", 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5767e-05 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.951 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.199341891, 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063305380000000001, 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728885+0000", 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728993+0000", 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108399 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729010+0000", 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6674999999999999e-05 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729017+0000", 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4760000000000001e-06 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729076+0000", 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8768999999999999e-05 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729087+0000", 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0370999999999999e-05 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735190+0000", 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061034770000000004 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735216+0000", 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6321000000000001e-05 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.198580212, 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075128, 2024-09-18T10:31:54.956 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729647+0000", 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729962+0000", 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031509799999999998 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729974+0000", 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2442999999999999e-05 2024-09-18T10:31:54.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729985+0000", 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0778000000000001e-05 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730933+0000", 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094732900000000001 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730946+0000", 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2981e-05 2024-09-18T10:31:54.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737129+0000", 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061833449999999998 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737160+0000", 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1452000000000003e-05 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.197363833000001, 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063226910000000001, 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730879+0000", 2024-09-18T10:31:54.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6008e-05 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730889+0000", 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6860000000000001e-06 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730894+0000", 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6339999999999998e-06 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731351+0000", 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000456577 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731360+0000", 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0520000000000007e-06 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737174+0000", 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058143250000000004 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737187+0000", 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2310000000000001e-05 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.285014017, 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056619699999999997, 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643213+0000", 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643236+0000", 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3031999999999999e-05 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643245+0000", 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6619999999999994e-06 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643251+0000", 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8529999999999997e-06 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643299+0000", 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7874000000000003e-05 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643308+0000", 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4390000000000006e-06 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648839+0000", 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055302210000000001 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648876+0000", 2024-09-18T10:31:54.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7181999999999997e-05 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 56/33 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.281958947, 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047824060000000003, 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3662000000000001e-05 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646306+0000", 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3517e-05 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646316+0000", 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8239999999999995e-06 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646393+0000", 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7268999999999995e-05 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646403+0000", 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0475999999999999e-05 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651027+0000", 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004623963 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651051+0000", 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3972e-05 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.281574365999999, 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066185949999999997, 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646674+0000", 2024-09-18T10:31:54.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1492e-05 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646686+0000", 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1752e-05 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646692+0000", 2024-09-18T10:31:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0260000000000004e-06 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646751+0000", 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9382000000000002e-05 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646762+0000", 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1042e-05 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653246+0000", 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064839570000000003 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653272+0000", 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5605999999999998e-05 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/33 ECSubWrite(tid=85, reqid=client.4589.0:456, at_version=56'26, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:31:54.979 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.649420+0000", 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.278808107, 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038659559999999998, 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649420+0000", 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649420+0000", 2024-09-18T10:31:54.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649419+0000", 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649586+0000", 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016696300000000001 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649602+0000", 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6538999999999999e-05 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649609+0000", 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7059999999999998e-06 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649675+0000", 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5672000000000004e-05 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649684+0000", 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8410000000000006e-06 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653276+0000", 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003592638 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653286+0000", 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4830000000000005e-06 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.983 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 56/33 ECSubWrite(tid=86, reqid=osd.5.0:83, at_version=0'0, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.651898+0000", 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.276330249000001, 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003763803, 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651898+0000", 2024-09-18T10:31:54.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651898+0000", 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651897+0000", 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651909+0000", 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.182e-05 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651924+0000", 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5744e-05 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651931+0000", 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3949999999999998e-06 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651978+0000", 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6804000000000001e-05 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651990+0000", 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2157999999999999e-05 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655627+0000", 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003637005 2024-09-18T10:31:54.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655661+0000", 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4660999999999999e-05 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=95, reqid=client.4589.0:487, at_version=60'41, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.327026513, 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.009354111, 2024-09-18T10:31:54.988 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601216+0000", 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5795e-05 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601228+0000", 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1372999999999999e-05 2024-09-18T10:31:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601234+0000", 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.178e-06 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601802+0000", 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056782999999999996 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601812+0000", 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.027e-05 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610535+0000", 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087234549999999998 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610555+0000", 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=96, reqid=osd.5.0:96, at_version=60'43, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.326165133, 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085102259999999992, 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:31:54.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602062+0000", 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602086+0000", 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.393e-05 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602098+0000", 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1949e-05 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602104+0000", 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3740000000000003e-06 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602590+0000", 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048540399999999999 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602599+0000", 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2029999999999998e-06 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610562+0000", 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079633459999999996 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610573+0000", 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0791000000000001e-05 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.325190869, 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067723929999999998, 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:54.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603070+0000", 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2941999999999997e-05 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:54.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603082+0000", 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2391e-05 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603088+0000", 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3280000000000002e-06 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603148+0000", 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0093000000000002e-05 2024-09-18T10:31:55.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603159+0000", 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0217999999999999e-05 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609781+0000", 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066224500000000002 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609809+0000", 2024-09-18T10:31:55.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8194000000000001e-05 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=97, reqid=osd.5.0:97, at_version=60'45, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.323745352, 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061409799999999999, 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604503+0000", 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1679e-05 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604516+0000", 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2172e-05 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604522+0000", 2024-09-18T10:31:55.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2430000000000002e-06 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604689+0000", 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166928 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604699+0000", 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0586e-05 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610607+0000", 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059073229999999999 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610623+0000", 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6792000000000001e-05 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 60/33 ECSubWrite(tid=98, reqid=osd.5.0:94, at_version=0'0, trim_to=0'0, roll_forward_to=60'32))", 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.606263+0000", 2024-09-18T10:31:55.006 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.321965266999999, 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035759450000000001, 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606263+0000", 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606263+0000", 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606262+0000", 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606275+0000", 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3191e-05 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606292+0000", 2024-09-18T10:31:55.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7110000000000001e-05 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606299+0000", 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2169999999999997e-06 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606354+0000", 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4561999999999997e-05 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606364+0000", 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0400999999999999e-05 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609815+0000", 2024-09-18T10:31:55.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034507969999999998 2024-09-18T10:31:55.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609838+0000", 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3566000000000001e-05 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWriteReply(3.4s0 60/33 ECSubWriteReply(tid=55, last_complete=60'46, committed=1, applied=1))", 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.606466+0000", 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.321761597, 2024-09-18T10:31:55.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038593730000000001, 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606466+0000", 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606466+0000", 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606465+0000", 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606471+0000", 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8100000000000003e-06 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606484+0000", 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2526e-05 2024-09-18T10:31:55.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.606490+0000", 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.297e-06 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610310+0000", 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038203859999999998 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610326+0000", 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5109999999999999e-05 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.316866253000001, 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058420499999999997, 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.016 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611361+0000", 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611370+0000", 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1959999999999997e-06 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611381+0000", 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1175000000000001e-05 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611386+0000", 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6059999999999996e-06 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611448+0000", 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1869e-05 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611457+0000", 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6609999999999995e-06 2024-09-18T10:31:55.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617180+0000", 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057225189999999997 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617204+0000", 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3652e-05 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.3265759369999994, 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004305578, 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601777+0000", 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012559 2024-09-18T10:31:55.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601798+0000", 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1138999999999999e-05 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601809+0000", 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1069e-05 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601881+0000", 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2056000000000003e-05 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601892+0000", 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605917+0000", 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040245489999999997 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605957+0000", 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0605999999999997e-05 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.025 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:55.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:31:55.027 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:55.024+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:55.127 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:55.126+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:55.129 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:31:55.129 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:55.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:31:55.228 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:55.227+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:55.280 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:55.280 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:55.280 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:55.281 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:55.281 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:55.289 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:31:55.329 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:55.328+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.792990119999999, 2024-09-18T10:31:55.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045952509999999998, 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597803+0000", 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597814+0000", 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1413999999999999e-05 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597824+0000", 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6989999999999998e-06 2024-09-18T10:31:55.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597830+0000", 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9839999999999998e-06 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597886+0000", 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6334e-05 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597895+0000", 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5599999999999994e-06 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602372+0000", 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044773520000000004 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602399+0000", 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6472e-05 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.783803973000001, 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047167229999999999, 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606989+0000", 2024-09-18T10:31:55.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607014+0000", 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4873999999999999e-05 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607029+0000", 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5136e-05 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607036+0000", 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7340000000000002e-06 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607236+0000", 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020045800000000001 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607246+0000", 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.009e-05 2024-09-18T10:31:55.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611683+0000", 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044365819999999997 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611706+0000", 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3509000000000001e-05 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.402 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.783732037, 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046098479999999997, 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:31:55.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607061+0000", 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607083+0000", 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1835999999999999e-05 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607093+0000", 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9049999999999992e-06 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607100+0000", 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2450000000000001e-06 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607147+0000", 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7092999999999998e-05 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607154+0000", 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5799999999999997e-06 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611645+0000", 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044915099999999998 2024-09-18T10:31:55.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611671+0000", 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6421999999999999e-05 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.789459706999999, 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010486074, 2024-09-18T10:31:55.407 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601333+0000", 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601448+0000", 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115426 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601462+0000", 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3579e-05 2024-09-18T10:31:55.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601469+0000", 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0530000000000001e-06 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601650+0000", 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000181273 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601659+0000", 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3739999999999998e-06 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611795+0000", 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010135877999999999 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611820+0000", 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5400000000000001e-05 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.788188962, 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095436749999999997, 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:31:55.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602604+0000", 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602653+0000", 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8948e-05 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602666+0000", 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2779000000000001e-05 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602674+0000", 2024-09-18T10:31:55.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3210000000000005e-06 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602759+0000", 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5636999999999993e-05 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602770+0000", 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0465000000000001e-05 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612126+0000", 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093557369999999994 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612148+0000", 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2736000000000001e-05 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.416 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.787031572, 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084016750000000008, 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603761+0000", 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603784+0000", 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2696000000000001e-05 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603798+0000", 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4199000000000001e-05 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603805+0000", 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6200000000000001e-06 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603872+0000", 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7512e-05 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603883+0000", 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729e-05 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612153+0000", 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082698349999999997 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.078e-05 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.66385315, 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065126710000000003, 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.421 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.422 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726940+0000", 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727360+0000", 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041924799999999999 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727372+0000", 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2152e-05 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727379+0000", 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8730000000000001e-06 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727436+0000", 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7802e-05 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727446+0000", 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2520000000000005e-06 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733427+0000", 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059812659999999998 2024-09-18T10:31:55.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733453+0000", 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6302e-05 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.661808055, 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075586109999999998, 2024-09-18T10:31:55.426 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.427 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728985+0000", 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729148+0000", 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016313100000000001 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729165+0000", 2024-09-18T10:31:55.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7489000000000001e-05 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729182+0000", 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6079999999999999e-05 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729230+0000", 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8004000000000003e-05 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729240+0000", 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0327e-05 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736514+0000", 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072737649999999997 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736544+0000", 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0602000000000003e-05 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.430 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.65976594, 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055584830000000003, 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731027+0000", 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731125+0000", 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8250000000000003e-05 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731138+0000", 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3022e-05 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731146+0000", 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.571e-06 2024-09-18T10:31:55.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731229+0000", 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3368999999999994e-05 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731239+0000", 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5880000000000004e-06 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736576+0000", 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053372209999999996 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736586+0000", 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0389e-05 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:31:55.435 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.659633298999999, 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054374030000000004, 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:31:55.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731178+0000", 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8043999999999999e-05 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731187+0000", 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0189999999999995e-06 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731193+0000", 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6169999999999998e-06 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731650+0000", 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045705799999999999 2024-09-18T10:31:55.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731659+0000", 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4630000000000007e-06 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736588+0000", 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004929124 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736598+0000", 2024-09-18T10:31:55.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5089999999999999e-06 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=212, reqid=osd.4.0:212, at_version=56'57, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.751032462, 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046823120000000001, 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639788+0000", 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6826999999999999e-05 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639799+0000", 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1231e-05 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639805+0000", 2024-09-18T10:31:55.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6290000000000004e-06 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639867+0000", 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1551999999999996e-05 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639877+0000", 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0308e-05 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644419+0000", 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045418610000000003 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644444+0000", 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4377999999999999e-05 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.444 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=215, reqid=client.4589.0:459, at_version=56'59, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.747347239, 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048391809999999997, 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.445 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643445+0000", 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643467+0000", 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1481e-05 2024-09-18T10:31:55.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643482+0000", 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4612e-05 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643490+0000", 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2150000000000001e-06 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643544+0000", 2024-09-18T10:31:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4302000000000003e-05 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643556+0000", 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2136999999999999e-05 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648259+0000", 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047024700000000003 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648286+0000", 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6923999999999998e-05 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=216, reqid=client.4589.0:460, at_version=56'60, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.747032507, 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045387350000000003, 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.449 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:31:55.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643788+0000", 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7053e-05 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643797+0000", 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5810000000000003e-06 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643803+0000", 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6590000000000004e-06 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644611+0000", 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080760000000000001 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644619+0000", 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7770000000000008e-06 2024-09-18T10:31:55.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648290+0000", 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003670539 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648300+0000", 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9699999999999994e-06 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 56/33 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.744501479, 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040949139999999998, 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646313+0000", 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.128e-05 2024-09-18T10:31:55.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646325+0000", 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1494e-05 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646335+0000", 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0295999999999999e-05 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646388+0000", 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3362999999999997e-05 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646396+0000", 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8180000000000004e-06 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650347+0000", 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039510020000000003 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650387+0000", 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9885000000000002e-05 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.744094152000001, 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045182080000000001, 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.458 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646699+0000", 2024-09-18T10:31:55.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646718+0000", 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646728+0000", 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4690000000000003e-06 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646733+0000", 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5550000000000002e-06 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646780+0000", 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6839000000000003e-05 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646789+0000", 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651195+0000", 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044061660000000004 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651218+0000", 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2518999999999999e-05 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=92, reqid=client.4589.0:485, at_version=60'39, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.792829256999999, 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041052750000000002, 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597989+0000", 2024-09-18T10:31:55.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598002+0000", 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2218999999999999e-05 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598008+0000", 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8430000000000004e-06 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598070+0000", 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1849999999999999e-05 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598082+0000", 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602043+0000", 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039603920000000001 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602070+0000", 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7098999999999999e-05 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=93, reqid=client.4589.0:486, at_version=60'40, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.791484123, 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046809249999999998, 2024-09-18T10:31:55.467 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599309+0000", 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599330+0000", 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1630000000000001e-05 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599366+0000", 2024-09-18T10:31:55.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5364000000000002e-05 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599374+0000", 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1799999999999996e-06 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599422+0000", 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7868000000000003e-05 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599432+0000", 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8409999999999995e-06 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603965+0000", 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045336689999999997 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603990+0000", 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5258000000000001e-05 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.471 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.779424188, 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051192939999999999, 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611380+0000", 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611392+0000", 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611399+0000", 2024-09-18T10:31:55.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1130000000000003e-06 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611450+0000", 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0590000000000002e-05 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611461+0000", 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0616e-05 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616457+0000", 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049963660000000003 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616489+0000", 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1863999999999998e-05 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 60/33 ECSubWrite(tid=243, reqid=osd.4.0:243, at_version=60'76, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:55.476 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.612486+0000", 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 10.778308139, 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040418750000000003, 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612486+0000", 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612486+0000", 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612485+0000", 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612505+0000", 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0435999999999999e-05 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612521+0000", 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5719999999999999e-05 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612527+0000", 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3600000000000001e-06 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612602+0000", 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5034e-05 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.612612+0000", 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8889999999999997e-06 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616491+0000", 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038785080000000001 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616527+0000", 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6613000000000003e-05 2024-09-18T10:31:55.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 65/33 ECSubWrite(tid=107, reqid=client.4589.0:543, at_version=65'52, trim_to=0'0, roll_forward_to=64'51))", 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.7292771079999998, 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047841719999999997, 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:55.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661516+0000", 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:31:55.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662367+0000", 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000850492 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662384+0000", 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6991e-05 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662391+0000", 2024-09-18T10:31:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1709999999999996e-06 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662450+0000", 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8943999999999997e-05 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662462+0000", 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2033e-05 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666279+0000", 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038165149999999999 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666301+0000", 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:55.485 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:55.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:31:55.487 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:55.485+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:55.588 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:55.587+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:55.597 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:55.598 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:55.598 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:55.598 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-18T10:31:55.605 INFO:tasks.rados.rados.0.smithi160.stdout:222: done (0 left) 2024-09-18T10:31:55.605 INFO:tasks.rados.rados.0.smithi160.stdout:223: rmattr oid 36 current snap is 18 2024-09-18T10:31:55.605 INFO:tasks.rados.rados.0.smithi160.stdout:223: done (0 left) 2024-09-18T10:31:55.605 INFO:tasks.rados.rados.0.smithi160.stdout:224: copy_from oid 23 from oid 20 current snap is 18 2024-09-18T10:31:55.605 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 37 current snap is 18 2024-09-18T10:31:55.605 INFO:tasks.rados.rados.0.smithi160.stdout:225: seq_num 107 ranges {720896=638976,1359872=458752,1818624=704512} 2024-09-18T10:31:55.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:31:55.612 INFO:tasks.rados.rados.0.smithi160.stdout:225: writing smithi16036501-37 from 720896 to 1359872 tid 1 2024-09-18T10:31:55.615 INFO:tasks.rados.rados.0.smithi160.stdout:225: writing smithi16036501-37 from 1359872 to 1818624 tid 2 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:225: writing smithi16036501-37 from 1818624 to 2523136 tid 3 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:224: finishing copy_from racing read to smithi16036501-23 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:226: rollback oid 50 current snap is 18 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 50 to 15 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:227: copy_from oid 16 from oid 22 current snap is 18 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:228: setattr oid 17 current snap is 18 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:224: finishing copy_from to smithi16036501-23 2024-09-18T10:31:55.620 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 23 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-18T10:31:55.623 INFO:tasks.rados.rados.0.smithi160.stdout:224: done (4 left) 2024-09-18T10:31:55.623 INFO:tasks.rados.rados.0.smithi160.stdout:229: delete oid 43 current snap is 18 2024-09-18T10:31:55.623 INFO:tasks.rados.rados.0.smithi160.stdout:225: finishing write tid 1 to smithi16036501-37 2024-09-18T10:31:55.625 INFO:tasks.rados.rados.0.smithi160.stdout:225: finishing write tid 2 to smithi16036501-37 2024-09-18T10:31:55.627 INFO:tasks.rados.rados.0.smithi160.stdout:226: finishing rollback tid 0 to smithi16036501-50 2024-09-18T10:31:55.628 INFO:tasks.rados.rados.0.smithi160.stdout:226: finishing rollback tid 1 to smithi16036501-50 2024-09-18T10:31:55.628 INFO:tasks.rados.rados.0.smithi160.stdout:226: finishing rollback tid 2 to smithi16036501-50 2024-09-18T10:31:55.629 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 50 v 29 (ObjNum 100 snap 14 seq_num 100) dirty exists 2024-09-18T10:31:55.631 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 74 (ObjNum 72 snap 5 seq_num 72) dirty exists 2024-09-18T10:31:55.631 INFO:tasks.rados.rados.0.smithi160.stdout:226: done (4 left) 2024-09-18T10:31:55.631 INFO:tasks.rados.rados.0.smithi160.stdout:228: done (3 left) 2024-09-18T10:31:55.631 INFO:tasks.rados.rados.0.smithi160.stdout:229: done (2 left) 2024-09-18T10:31:55.631 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 49 current snap is 18 2024-09-18T10:31:55.631 INFO:tasks.rados.rados.0.smithi160.stdout:230: seq_num 109 ranges {2555904=671744,3227648=753664,3981312=409600} 2024-09-18T10:31:55.648 INFO:tasks.rados.rados.0.smithi160.stdout:230: writing smithi16036501-49 from 2555904 to 3227648 tid 1 2024-09-18T10:31:55.653 INFO:tasks.rados.rados.0.smithi160.stdout:230: writing smithi16036501-49 from 3227648 to 3981312 tid 2 2024-09-18T10:31:55.655 INFO:tasks.rados.rados.0.smithi160.stdout:230: writing smithi16036501-49 from 3981312 to 4390912 tid 3 2024-09-18T10:31:55.655 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 1 current snap is 18 2024-09-18T10:31:55.655 INFO:tasks.rados.rados.0.smithi160.stdout:231: seq_num 110 ranges {2654208=688128,3342336=507904,3850240=655360} 2024-09-18T10:31:55.673 INFO:tasks.rados.rados.0.smithi160.stdout:231: writing smithi16036501-1 from 2654208 to 3342336 tid 1 2024-09-18T10:31:55.676 INFO:tasks.rados.rados.0.smithi160.stdout:231: writing smithi16036501-1 from 3342336 to 3850240 tid 2 2024-09-18T10:31:55.681 INFO:tasks.rados.rados.0.smithi160.stdout:231: writing smithi16036501-1 from 3850240 to 4505600 tid 3 2024-09-18T10:31:55.681 INFO:tasks.rados.rados.0.smithi160.stdout:232: rmattr oid 26 current snap is 18 2024-09-18T10:31:55.681 INFO:tasks.rados.rados.0.smithi160.stdout:232: done (4 left) 2024-09-18T10:31:55.681 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 39 current snap is 18 2024-09-18T10:31:55.681 INFO:tasks.rados.rados.0.smithi160.stdout:227: finishing copy_from racing read to smithi16036501-16 2024-09-18T10:31:55.681 INFO:tasks.rados.rados.0.smithi160.stdout:233: seq_num 111 ranges {638976=704512,1343488=655360,1998848=507904} 2024-09-18T10:31:55.688 INFO:tasks.rados.rados.0.smithi160.stdout:233: writing smithi16036501-39 from 638976 to 1343488 tid 1 2024-09-18T10:31:55.689 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:55.687+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:55.692 INFO:tasks.rados.rados.0.smithi160.stdout:233: writing smithi16036501-39 from 1343488 to 1998848 tid 2 2024-09-18T10:31:55.695 INFO:tasks.rados.rados.0.smithi160.stdout:233: writing smithi16036501-39 from 1998848 to 2506752 tid 3 2024-09-18T10:31:55.695 INFO:tasks.rados.rados.0.smithi160.stdout:234: read oid 44 snap -1 2024-09-18T10:31:55.695 INFO:tasks.rados.rados.0.smithi160.stdout:234: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:55.695 INFO:tasks.rados.rados.0.smithi160.stdout:235: snap_remove snap 15 2024-09-18T10:31:55.716 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:55.716 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:55.716 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:55.716 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:55.716 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:55.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:31:55.790 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:31:55.789+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=7, reqid=osd.14.0:7, at_version=40'6, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.567306234, 2024-09-18T10:31:55.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024793150000000002, 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293784+0000", 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293834+0000", 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9882000000000001e-05 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293848+0000", 2024-09-18T10:31:55.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3913e-05 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293857+0000", 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293910+0000", 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2933999999999998e-05 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293919+0000", 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3440000000000007e-06 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296229+0000", 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023091040000000002 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296264+0000", 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5673999999999998e-05 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 40/33 ECSubWrite(tid=65, reqid=osd.13.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=40'15))", 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.562520922000001, 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004430000000002, 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:31:55.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298569+0000", 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298587+0000", 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7978999999999998e-05 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298607+0000", 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9627e-05 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298628+0000", 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1246e-05 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298695+0000", 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7471999999999994e-05 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298707+0000", 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1379000000000001e-05 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301022+0000", 2024-09-18T10:31:55.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00231526 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301071+0000", 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.562196362000002, 2024-09-18T10:31:55.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049479429999999998, 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298894+0000", 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298909+0000", 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4646e-05 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298921+0000", 2024-09-18T10:31:55.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2830000000000001e-05 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298942+0000", 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0462000000000002e-05 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298993+0000", 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0968999999999999e-05 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299001+0000", 2024-09-18T10:31:55.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1319999999999994e-06 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303821+0000", 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048198410000000001 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303843+0000", 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1846000000000001e-05 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 44/33 ECSubWrite(tid=74, reqid=client.4589.0:278, at_version=44'22, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.319164+0000", 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.541927036000001, 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019058440000000001, 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319164+0000", 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319164+0000", 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319163+0000", 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319269+0000", 2024-09-18T10:31:55.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010552699999999999 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319281+0000", 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2108e-05 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319287+0000", 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9030000000000001e-06 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319329+0000", 2024-09-18T10:31:55.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1959999999999998e-05 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319339+0000", 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6369999999999994e-06 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.321049+0000", 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017104209999999999 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.321070+0000", 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0973999999999999e-05 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 45/33 ECSubWrite(tid=79, reqid=client.4589.0:295, at_version=45'24, trim_to=0'0, roll_forward_to=44'22))", 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.536788011999999, 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052771249999999997, 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:31:55.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324448+0000", 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014492199999999999 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324465+0000", 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6928000000000001e-05 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324473+0000", 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4290000000000001e-06 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324536+0000", 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3182000000000006e-05 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324547+0000", 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0407999999999999e-05 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329548+0000", 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050016779999999999 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329580+0000", 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1859000000000001e-05 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.885 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 45/33 ECSubWrite(tid=80, reqid=client.4589.0:295, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.528617574999998, 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002518607, 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332473+0000", 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332485+0000", 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2669e-05 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332500+0000", 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.472e-05 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332508+0000", 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6480000000000003e-06 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332567+0000", 2024-09-18T10:31:55.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9750999999999998e-05 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332577+0000", 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7070000000000004e-06 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.334961+0000", 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023839180000000001 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.334992+0000", 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1109000000000003e-05 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.254048732000001, 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023816800000000002, 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:31:55.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607066+0000", 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4323000000000001e-05 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607084+0000", 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7872000000000001e-05 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607091+0000", 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2239999999999998e-06 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607153+0000", 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1663999999999998e-05 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607163+0000", 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8989999999999996e-06 2024-09-18T10:31:55.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.609402+0000", 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022393780000000002 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.609424+0000", 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.894 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 49/33 ECSubWrite(tid=173, reqid=osd.4.0:172, at_version=0'0, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.612692+0000", 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.248399503000002, 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002061266, 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612692+0000", 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612692+0000", 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612691+0000", 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612701+0000", 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0054999999999999e-05 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612714+0000", 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2662e-05 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612718+0000", 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.865e-06 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612764+0000", 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5741999999999997e-05 2024-09-18T10:31:55.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612776+0000", 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1644000000000001e-05 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.614726+0000", 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001950348 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.614753+0000", 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6727e-05 2024-09-18T10:31:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 56/33 ECSubWrite(tid=213, reqid=client.4589.0:458, at_version=56'58, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.219780889999999, 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028836209999999998, 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641309+0000", 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641330+0000", 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0845000000000001e-05 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641581+0000", 2024-09-18T10:31:55.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025098500000000001 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641589+0000", 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5650000000000004e-06 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641637+0000", 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8804999999999998e-05 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641647+0000", 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644164+0000", 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002517437 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644194+0000", 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9390000000000002e-05 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(3.as1 epoch 56/33 rep_tid 121 entries 56'31 (0'0) error 3:52d3343a:::smithi16036501-18:head by client.4589.0:461 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 49'28)", 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.218451819, 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024779099999999998, 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642654+0000", 2024-09-18T10:31:55.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4662e-05 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642672+0000", 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8542999999999998e-05 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642696+0000", 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3676000000000002e-05 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642783+0000", 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7560999999999997e-05 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645117+0000", 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023339139999999999 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:31:55.907 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.218372005000001, 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00237638, 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642739+0000", 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0530000000000002e-05 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642762+0000", 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2841999999999999e-05 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642770+0000", 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5920000000000003e-06 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642820+0000", 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0701000000000001e-05 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642830+0000", 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0086e-05 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645068+0000", 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022371769999999999 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645095+0000", 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7883000000000001e-05 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.911 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 56/33 ECSubWrite(tid=215, reqid=client.4589.0:459, at_version=56'59, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.643202+0000", 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.21788901, 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001769133, 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643202+0000", 2024-09-18T10:31:55.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643202+0000", 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643201+0000", 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643232+0000", 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1096999999999997e-05 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643246+0000", 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482999999999999e-05 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643253+0000", 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9539999999999998e-06 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643304+0000", 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1690999999999997e-05 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643314+0000", 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9289999999999993e-06 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644945+0000", 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016307050000000001 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644971+0000", 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6217999999999999e-05 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 56/33 ECSubWrite(tid=125, reqid=osd.13.0:125, at_version=56'33, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.206302365999999, 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062986129999999998, 2024-09-18T10:31:55.916 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654788+0000", 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654813+0000", 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5276999999999999e-05 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654829+0000", 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5387999999999999e-05 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654835+0000", 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8990000000000004e-06 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654888+0000", 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3004999999999998e-05 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654900+0000", 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.661062+0000", 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061620340000000003 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.661087+0000", 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789999999999999e-05 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.920 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.259053164999999, 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030576539999999999, 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602066+0000", 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8413000000000001e-05 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602076+0000", 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0227000000000001e-05 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602083+0000", 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.331e-06 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602173+0000", 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9917e-05 2024-09-18T10:31:55.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602183+0000", 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893000000000001e-05 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605062+0000", 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028786240000000002 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605096+0000", 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3578000000000003e-05 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=237, reqid=osd.4.0:237, at_version=60'72, trim_to=0'0, roll_forward_to=59'70))", 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.258335922000001, 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002715496, 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.925 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602779+0000", 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4559e-05 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602792+0000", 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2183e-05 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602798+0000", 2024-09-18T10:31:55.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5379999999999999e-06 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602861+0000", 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3260000000000001e-05 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602876+0000", 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.464e-05 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605441+0000", 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025647399999999998 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605471+0000", 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.989e-05 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=242, reqid=osd.4.0:239, at_version=0'0, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:55.929 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.249841256, 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663030000000001, 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:31:55.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611249+0000", 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611263+0000", 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3712e-05 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611278+0000", 2024-09-18T10:31:55.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5489e-05 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611286+0000", 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4390000000000003e-06 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611354+0000", 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8612e-05 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611374+0000", 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614397+0000", 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030227909999999999 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614416+0000", 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9406999999999999e-05 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=243, reqid=osd.4.0:243, at_version=60'76, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.248513974, 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043321790000000002, 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612576+0000", 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612598+0000", 2024-09-18T10:31:55.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2039999999999999e-05 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612610+0000", 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1712999999999999e-05 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612615+0000", 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9219999999999996e-06 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612676+0000", 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0674000000000002e-05 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612688+0000", 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2687000000000001e-05 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616881+0000", 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041925180000000001 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616909+0000", 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8391999999999999e-05 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=244, reqid=osd.4.0:244, at_version=60'78, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.24742466, 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061258190000000002, 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:31:55.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613685+0000", 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9247000000000001e-05 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613696+0000", 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1361e-05 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613701+0000", 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0030000000000002e-06 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613740+0000", 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9100000000000002e-05 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613764+0000", 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3413000000000001e-05 2024-09-18T10:31:55.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619771+0000", 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060067280000000002 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619792+0000", 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1707000000000001e-05 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.259499809999999, 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026074700000000002, 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601684+0000", 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2781999999999994e-05 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601697+0000", 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601704+0000", 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.754e-06 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601779+0000", 2024-09-18T10:31:55.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4917000000000001e-05 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601791+0000", 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2808e-05 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604162+0000", 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023708620000000001 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604199+0000", 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6424000000000002e-05 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 71/33 ECSubWrite(tid=307, reqid=client.4589.0:588, at_version=71'96, trim_to=0'0, roll_forward_to=71'93))", 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.697960+0000", 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.16313085099999999, 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021479720000000002, 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:55.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.697960+0000", 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.697960+0000", 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.697960+0000", 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:55.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.697974+0000", 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4086e-05 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.697982+0000", 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0819999999999999e-06 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:55.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.697986+0000", 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.737e-06 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.698013+0000", 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7761999999999999e-05 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.698021+0000", 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5870000000000004e-06 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:55.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.700089+0000", 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002068308 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.700108+0000", 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8899999999999999e-05 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:55.951 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:55.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:31:55.953 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:55.951+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:56.053 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:56.052+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:56.092 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:56.092 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:56.092 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:56.092 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:56.100 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:31:56.154 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:56.152+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:56.237 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:56.237 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:56.237 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:56.237 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:56.238 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:56.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:31:56.255 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:56.254+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:56.344 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:56.344 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:56.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:56.344 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:205 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.072063368000002, 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076111369999999996, 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 205 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.345 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270043+0000", 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270042+0000", 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270046+0000", 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4120000000000001e-06 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270052+0000", 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6279999999999999e-06 2024-09-18T10:31:56.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270056+0000", 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3749999999999999e-06 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270134+0000", 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8008000000000003e-05 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270137+0000", 2024-09-18T10:31:56.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.574e-06 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274639+0000", 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045012020000000002 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.274720+0000", 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1095999999999997e-05 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.277654+0000", 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029342470000000001 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:206 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.072032511000003, 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081552699999999992, 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:56.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270073+0000", 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270076+0000", 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1389999999999999e-06 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270082+0000", 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8329999999999999e-06 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270087+0000", 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7589999999999997e-06 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270158+0000", 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1110000000000002e-05 2024-09-18T10:31:56.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270163+0000", 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1370000000000001e-06 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275879+0000", 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005716133 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275935+0000", 2024-09-18T10:31:56.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5587999999999997e-05 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.278229+0000", 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022939829999999999 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 45/33 ECSubWrite(tid=51, reqid=client.4589.0:297, at_version=45'43, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.017804907999999, 2024-09-18T10:31:56.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078576380000000001, 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324301+0000", 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324924+0000", 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062299700000000003 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324936+0000", 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1817000000000001e-05 2024-09-18T10:31:56.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324943+0000", 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3509999999999996e-06 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324996+0000", 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3429e-05 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325006+0000", 2024-09-18T10:31:56.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.115e-06 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332137+0000", 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071312069999999997 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332159+0000", 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2137000000000002e-05 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 45/33 ECSubWrite(tid=79, reqid=client.4589.0:295, at_version=45'24, trim_to=0'0, roll_forward_to=44'22))", 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324529+0000", 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.017577411000001, 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076180930000000003, 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324529+0000", 2024-09-18T10:31:56.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324529+0000", 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324528+0000", 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324806+0000", 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027733199999999998 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324819+0000", 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3662000000000001e-05 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324828+0000", 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6330000000000002e-06 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324885+0000", 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7207999999999998e-05 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324896+0000", 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0817e-05 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332114+0000", 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072178320000000004 2024-09-18T10:31:56.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332147+0000", 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2851000000000001e-05 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 45/33 ECSubWrite(tid=52, reqid=client.4589.0:298, at_version=45'44, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.327133+0000", 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.014973526999999, 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080173789999999998, 2024-09-18T10:31:56.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327133+0000", 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327133+0000", 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327132+0000", 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327317+0000", 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000185465 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327347+0000", 2024-09-18T10:31:56.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9408999999999999e-05 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327353+0000", 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3820000000000001e-06 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327395+0000", 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2193000000000001e-05 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.327406+0000", 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0825999999999999e-05 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335130+0000", 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077239659999999996 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335150+0000", 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9848e-05 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:436 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~770048] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.619877488, 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011429902, 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 436 2024-09-18T10:31:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722227+0000", 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723088+0000", 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086064300000000002 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723103+0000", 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5194000000000001e-05 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723126+0000", 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3286e-05 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723184+0000", 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8409000000000003e-05 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723195+0000", 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0127e-05 2024-09-18T10:31:56.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725088+0000", 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932479999999999 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725155+0000", 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7061e-05 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.726518+0000", 2024-09-18T10:31:56.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001363076 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730117+0000", 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003598778 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733596+0000", 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034793699999999999 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733659+0000", 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2459999999999995e-05 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:437 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~475136] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.616736732, 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013490482, 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 437 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725368+0000", 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725831+0000", 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046283199999999999 2024-09-18T10:31:56.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725844+0000", 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3121e-05 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725851+0000", 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.674e-06 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727646+0000", 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017952199999999999 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727719+0000", 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3166999999999999e-05 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728450+0000", 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073089599999999998 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730201+0000", 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001750564 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738806+0000", 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008605171 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738860+0000", 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4008999999999997e-05 2024-09-18T10:31:56.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:438 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~294912] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.615012331999999, 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01193583, 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 438 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727093+0000", 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727437+0000", 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034437500000000001 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727451+0000", 2024-09-18T10:31:56.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4089e-05 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727463+0000", 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2179e-05 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728987+0000", 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015242299999999999 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729057+0000", 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9201000000000004e-05 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729526+0000", 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046947999999999998 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731168+0000", 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016422959999999999 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738978+0000", 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078093099999999999 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739030+0000", 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1910999999999998e-05 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:439 3.5s0 3:ac3be3d0:::smithi16036501-3:head [setxattr _header (56) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.386 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.614634597999999, 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011721551, 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 439 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727471+0000", 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727476+0000", 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1399999999999999e-06 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727485+0000", 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4590000000000004e-06 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727492+0000", 2024-09-18T10:31:56.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4450000000000001e-06 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730312+0000", 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028200730000000002 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730376+0000", 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3989e-05 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730729+0000", 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353099 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731679+0000", 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095002300000000003 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739133+0000", 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074541119999999997 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739193+0000", 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0016000000000003e-05 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:440 3.5s0 3:ac3be3d0:::smithi16036501-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.614607067000001, 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013207774, 2024-09-18T10:31:56.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 440 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727503+0000", 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2220000000000004e-06 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727512+0000", 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1789999999999997e-06 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727521+0000", 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730982+0000", 2024-09-18T10:31:56.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003461357 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731094+0000", 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011191700000000001 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739479+0000", 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083848180000000005 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739571+0000", 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1942999999999997e-05 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.740707+0000", 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011359429999999999 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.397 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:450 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~786432] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.563300682000001, 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083772540000000006, 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 450 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778803+0000", 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:56.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779445+0000", 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064144400000000002 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779458+0000", 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3027000000000001e-05 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779462+0000", 2024-09-18T10:31:56.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5859999999999998e-06 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779514+0000", 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1320000000000003e-05 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779580+0000", 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6484999999999998e-05 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.780535+0000", 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095481799999999996 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.781925+0000", 2024-09-18T10:31:56.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013899489999999999 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787115+0000", 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051898500000000002 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787183+0000", 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8021999999999993e-05 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:454 3.cs0 3:3616aa10:::smithi16036501-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.785155+0000", 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.556951333000001, 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073055749999999999, 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.404 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 454 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785155+0000", 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785155+0000", 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785154+0000", 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785157+0000", 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7310000000000002e-06 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785164+0000", 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.669e-06 2024-09-18T10:31:56.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.785168+0000", 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8619999999999996e-06 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787392+0000", 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022244439999999999 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787462+0000", 2024-09-18T10:31:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9846999999999997e-05 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.791537+0000", 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040754010000000002 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.791601+0000", 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3668000000000001e-05 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.792460+0000", 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00085944500000000002 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:456 3.5s0 3:ac3be3d0:::smithi16036501-3:head [copy-from ver 4] snapc 13=[d,6] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.701855570999999, 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01601, 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 456 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640248+0000", 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640263+0000", 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4487e-05 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640282+0000", 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9524000000000001e-05 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640289+0000", 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5939999999999999e-06 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9294000000000004e-05 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640367+0000", 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0170000000000002e-06 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645378+0000", 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050108269999999998 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645496+0000", 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118449 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.649412+0000", 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039156800000000004 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650429+0000", 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00101706 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656201+0000", 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057721049999999996 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656261+0000", 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9450999999999997e-05 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.415 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:457 3.5s0 3:ac3be3d0:::smithi16036501-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.701801383999999, 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099350510000000003, 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 457 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640304+0000", 2024-09-18T10:31:56.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640308+0000", 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.631e-06 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640315+0000", 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4590000000000001e-06 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640319+0000", 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.721e-06 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640554+0000", 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000235047 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640562+0000", 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1110000000000008e-06 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645694+0000", 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051315149999999997 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645744+0000", 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0756e-05 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650099+0000", 2024-09-18T10:31:56.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043545509999999999 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650157+0000", 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8363999999999999e-05 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650240+0000", 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2596000000000007e-05 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 56/33 ECSubWrite(tid=125, reqid=osd.13.0:125, at_version=56'33, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 15.687273587, 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084899620000000002, 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:31:56.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654832+0000", 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654874+0000", 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1996999999999998e-05 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654890+0000", 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6705999999999999e-05 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654898+0000", 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654955+0000", 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7389000000000002e-05 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654966+0000", 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1353e-05 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663290+0000", 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083236720000000007 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663323+0000", 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2360999999999997e-05 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:485 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:56.426 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.746712812, 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092164380000000004, 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 485 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595391+0000", 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595401+0000", 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559999999999994e-06 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595421+0000", 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.052e-05 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595430+0000", 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8149999999999995e-06 2024-09-18T10:31:56.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595492+0000", 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2297000000000003e-05 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0696999999999999e-05 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597238+0000", 2024-09-18T10:31:56.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017347510000000001 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597314+0000", 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5784000000000005e-05 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597920+0000", 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060640599999999998 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600840+0000", 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029203670000000001 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604512+0000", 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036712759999999998 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8109000000000005e-05 2024-09-18T10:31:56.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:486 3.cs0 3:3616aa10:::smithi16036501-19:head [rollback 17] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.746628150999999, 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095267909999999997, 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 486 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:31:56.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595477+0000", 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595482+0000", 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9559999999999996e-06 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595489+0000", 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.866e-06 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595493+0000", 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4630000000000001e-06 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595574+0000", 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1390999999999994e-05 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595580+0000", 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2330000000000003e-06 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598599+0000", 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003018813 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598675+0000", 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6198000000000005e-05 2024-09-18T10:31:56.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.599265+0000", 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058946400000000005 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604855+0000", 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055906949999999997 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604930+0000", 2024-09-18T10:31:56.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5139e-05 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605005+0000", 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4320000000000007e-05 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:487 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.746608007000001, 2024-09-18T10:31:56.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015332254999999999, 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 487 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595500+0000", 2024-09-18T10:31:56.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7999999999999999e-06 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3380000000000001e-06 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595505+0000", 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2419999999999999e-06 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595603+0000", 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7980999999999996e-05 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595610+0000", 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5710000000000003e-06 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600005+0000", 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043948529999999998 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600140+0000", 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135184 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600625+0000", 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048546199999999998 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605009+0000", 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043837019999999997 2024-09-18T10:31:56.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610750+0000", 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057406339999999997 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610830+0000", 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0711999999999996e-05 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.446 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:543 3.cs0 3:33d93753:::smithi16036501-12:head [copy-from ver 35] snapc 1e=[1e] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-18T10:31:56.446 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:31:56.446 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.6886930229999999, 2024-09-18T10:31:56.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013133835, 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 543 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653412+0000", 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653419+0000", 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.525e-06 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653431+0000", 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024999999999999e-05 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653436+0000", 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1070000000000004e-06 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653469+0000", 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3037000000000002e-05 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653533+0000", 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3468999999999998e-05 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.661263+0000", 2024-09-18T10:31:56.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007729774 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662684+0000", 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014210920000000001 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.666504+0000", 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003820164 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.666547+0000", 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3142000000000001e-05 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:544 3.cs0 3:33d93753:::smithi16036501-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.6886639060000004, 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089048649999999997, 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.453 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 544 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653444+0000", 2024-09-18T10:31:56.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7179999999999999e-06 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653448+0000", 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9020000000000001e-06 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653450+0000", 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2680000000000001e-06 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653638+0000", 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018801700000000001 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653671+0000", 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3623e-05 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662159+0000", 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084872190000000007 2024-09-18T10:31:56.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662242+0000", 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2961999999999996e-05 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662347+0000", 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010546499999999999 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.459 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.459 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:56.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:31:56.461 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:31:56.459+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:31:56.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:31:56.557 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:56.558 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:56.558 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:31:56.558 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:56.565 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:56.564+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:56.566 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:31:56.654 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:56.655 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:56.662 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:56.661+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:56.664 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:56.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:31:56.664 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:31:56.664 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:31:56.664 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:56.671 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:56.671 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:56.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:235: done (6 left) 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:236: rollback oid 36 current snap is 18 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:236: done (6 left) 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:237: rollback oid 36 current snap is 18 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:237: done (6 left) 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:238: delete oid 14 current snap is 18 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:225: finishing write tid 3 to smithi16036501-37 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:225: finishing write tid 4 to smithi16036501-37 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:225: finishing write tid 5 to smithi16036501-37 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 81 (ObjNum 107 snap 18 seq_num 107) dirty exists 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:225: left oid 37 (ObjNum 107 snap 18 seq_num 107) 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:227: finishing copy_from to smithi16036501-16 2024-09-18T10:31:56.687 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 70 (ObjNum 97 snap 13 seq_num 97) dirty exists 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:230: finishing write tid 1 to smithi16036501-49 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:230: finishing write tid 2 to smithi16036501-49 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:230: finishing write tid 3 to smithi16036501-49 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:230: finishing write tid 4 to smithi16036501-49 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:230: finishing write tid 5 to smithi16036501-49 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 49 v 54 (ObjNum 109 snap 18 seq_num 109) dirty exists 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:230: left oid 49 (ObjNum 109 snap 18 seq_num 109) 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:231: finishing write tid 1 to smithi16036501-1 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:231: finishing write tid 2 to smithi16036501-1 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:231: finishing write tid 3 to smithi16036501-1 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:231: finishing write tid 4 to smithi16036501-1 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:231: finishing write tid 5 to smithi16036501-1 2024-09-18T10:31:56.688 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 1 v 85 (ObjNum 110 snap 18 seq_num 110) dirty exists 2024-09-18T10:31:56.689 INFO:tasks.rados.rados.0.smithi160.stdout:231: left oid 1 (ObjNum 110 snap 18 seq_num 110) 2024-09-18T10:31:56.689 INFO:tasks.rados.rados.0.smithi160.stdout:233: finishing write tid 1 to smithi16036501-39 2024-09-18T10:31:56.689 INFO:tasks.rados.rados.0.smithi160.stdout:233: finishing write tid 2 to smithi16036501-39 2024-09-18T10:31:56.689 INFO:tasks.rados.rados.0.smithi160.stdout:233: finishing write tid 3 to smithi16036501-39 2024-09-18T10:31:56.689 INFO:tasks.rados.rados.0.smithi160.stdout:233: finishing write tid 4 to smithi16036501-39 2024-09-18T10:31:56.689 INFO:tasks.rados.rados.0.smithi160.stdout:234: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:31:56.693 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:56.693 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:56.713 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:56.713 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:233: finishing write tid 5 to smithi16036501-39 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 39 v 96 (ObjNum 111 snap 18 seq_num 111) dirty exists 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:233: left oid 39 (ObjNum 111 snap 18 seq_num 111) 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:225: done (6 left) 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:227: done (5 left) 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:230: done (4 left) 2024-09-18T10:31:56.728 INFO:tasks.rados.rados.0.smithi160.stdout:231: done (3 left) 2024-09-18T10:31:56.729 INFO:tasks.rados.rados.0.smithi160.stdout:233: done (2 left) 2024-09-18T10:31:56.729 INFO:tasks.rados.rados.0.smithi160.stdout:234: done (1 left) 2024-09-18T10:31:56.729 INFO:tasks.rados.rados.0.smithi160.stdout:238: done (0 left) 2024-09-18T10:31:56.729 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 26 current snap is 18 2024-09-18T10:31:56.729 INFO:tasks.rados.rados.0.smithi160.stdout:239: seq_num 113 ranges {2637824=737280,3375104=557056,3932160=606208} 2024-09-18T10:31:56.729 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:56.730 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:56.744 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:56.744 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:56.745 INFO:tasks.rados.rados.0.smithi160.stdout:239: writing smithi16036501-26 from 2637824 to 3375104 tid 1 2024-09-18T10:31:56.749 INFO:tasks.rados.rados.0.smithi160.stdout:239: writing smithi16036501-26 from 3375104 to 3932160 tid 2 2024-09-18T10:31:56.752 INFO:tasks.rados.rados.0.smithi160.stdout:239: writing smithi16036501-26 from 3932160 to 4538368 tid 3 2024-09-18T10:31:56.752 INFO:tasks.rados.rados.0.smithi160.stdout:240: snap_create 2024-09-18T10:31:56.752 INFO:tasks.rados.rados.0.smithi160.stdout:239: finishing write tid 1 to smithi16036501-26 2024-09-18T10:31:56.753 INFO:tasks.rados.rados.0.smithi160.stdout:239: finishing write tid 2 to smithi16036501-26 2024-09-18T10:31:56.756 INFO:tasks.rados.rados.0.smithi160.stdout:239: finishing write tid 3 to smithi16036501-26 2024-09-18T10:31:56.756 INFO:tasks.rados.rados.0.smithi160.stdout:239: finishing write tid 4 to smithi16036501-26 2024-09-18T10:31:56.758 INFO:tasks.rados.rados.0.smithi160.stdout:239: finishing write tid 5 to smithi16036501-26 2024-09-18T10:31:56.758 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 26 v 84 (ObjNum 113 snap 18 seq_num 113) dirty exists 2024-09-18T10:31:56.758 INFO:tasks.rados.rados.0.smithi160.stdout:239: left oid 26 (ObjNum 113 snap 18 seq_num 113) 2024-09-18T10:31:56.764 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:56.765 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:56.763+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:56.777 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:31:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:31:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.496127876999999, 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002559342, 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.279632+0000", 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280419+0000", 2024-09-18T10:31:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078655700000000001 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280432+0000", 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2958e-05 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280439+0000", 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1930000000000004e-06 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280487+0000", 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7725000000000001e-05 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.280495+0000", 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9109999999999993e-06 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.282168+0000", 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016732850000000001 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.282192+0000", 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3839e-05 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 39/33 ECSubWrite(tid=30, reqid=client.4589.0:208, at_version=39'20, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.494306524000002, 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003011279, 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281454+0000", 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281453+0000", 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281781+0000", 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032834699999999999 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281791+0000", 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1910000000000006e-06 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281795+0000", 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1470000000000003e-06 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281830+0000", 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5163999999999997e-05 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.281849+0000", 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9228e-05 2024-09-18T10:31:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284446+0000", 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025973480000000002 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.284465+0000", 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8488999999999999e-05 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=51, reqid=client.4589.0:297, at_version=45'43, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.450409276999999, 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069162599999999996, 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325351+0000", 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325429+0000", 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7943999999999998e-05 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325439+0000", 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0818e-05 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325449+0000", 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9930000000000007e-06 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325505+0000", 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5464000000000003e-05 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.325516+0000", 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0730000000000001e-05 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332243+0000", 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067279690000000003 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332267+0000", 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3694e-05 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=52, reqid=client.4589.0:298, at_version=45'44, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.447424984000001, 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068793300000000003, 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328335+0000", 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328880+0000", 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054557 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328890+0000", 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7210000000000006e-06 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328896+0000", 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9900000000000002e-06 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328936+0000", 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0389000000000002e-05 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328944+0000", 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9240000000000007e-06 2024-09-18T10:31:56.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335192+0000", 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062478330000000004 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335215+0000", 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2484e-05 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=53, reqid=client.4589.0:299, at_version=45'45, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.446855107000001, 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063241030000000002, 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328905+0000", 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328978+0000", 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3480999999999997e-05 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328986+0000", 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2709999999999992e-06 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.328997+0000", 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.027e-05 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329554+0000", 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00055778200000000005 2024-09-18T10:31:56.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329565+0000", 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0132000000000001e-05 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335219+0000", 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056541919999999997 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335229+0000", 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0404999999999999e-05 2024-09-18T10:31:56.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 45/33 ECSubWrite(tid=54, reqid=client.4589.0:300, at_version=45'46, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.330132+0000", 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.445628660000001, 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051063660000000002, 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330132+0000", 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330132+0000", 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330131+0000", 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330148+0000", 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7533e-05 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330160+0000", 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1565e-05 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330166+0000", 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0039999999999996e-06 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330209+0000", 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3446999999999999e-05 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.330218+0000", 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3319999999999992e-06 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335232+0000", 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005013974 2024-09-18T10:31:56.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.335238+0000", 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.246e-06 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.5s3 49/33 ECSubWrite(tid=62, reqid=osd.5.0:61, at_version=0'0, trim_to=0'0, roll_forward_to=49'16))", 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.594877+0000", 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.180883490999999, 2024-09-18T10:31:56.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023051909999999998, 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594877+0000", 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594877+0000", 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594876+0000", 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594898+0000", 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1682e-05 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594915+0000", 2024-09-18T10:31:56.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7963000000000001e-05 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594925+0000", 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6330000000000008e-06 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594970+0000", 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4393e-05 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.594979+0000", 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6199999999999994e-06 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.597156+0000", 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021764129999999999 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.597182+0000", 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.637e-05 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 49/33 ECSubWrite(tid=40, reqid=osd.3.0:40, at_version=49'29, trim_to=0'0, roll_forward_to=48'27))", 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.596268+0000", 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.179492676999999, 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027377209999999998, 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596268+0000", 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596268+0000", 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596267+0000", 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596317+0000", 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9401999999999999e-05 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596330+0000", 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596357+0000", 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6775999999999999e-05 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596437+0000", 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9275000000000002e-05 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.596445+0000", 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8389999999999996e-06 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.598979+0000", 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025338829999999998 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.599005+0000", 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.603e-05 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 49/33 ECSubWrite(tid=65, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.603841+0000", 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.171919501000001, 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034843650000000001, 2024-09-18T10:31:56.813 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603841+0000", 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603841+0000", 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603840+0000", 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603850+0000", 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0112000000000001e-05 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603859+0000", 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1400000000000006e-06 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603866+0000", 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9709999999999998e-06 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604013+0000", 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147004 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604024+0000", 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0681e-05 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607298+0000", 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032736610000000002 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607325+0000", 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7385999999999998e-05 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 49/33 ECSubWrite(tid=41, reqid=osd.3.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=49'29))", 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.171874845000001, 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034793089999999999, 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603885+0000", 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603894+0000", 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2879999999999998e-06 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603904+0000", 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0057999999999999e-05 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603911+0000", 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0539999999999997e-06 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604082+0000", 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017050400000000001 2024-09-18T10:31:56.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604091+0000", 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5019999999999998e-06 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607335+0000", 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032431880000000001 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607365+0000", 2024-09-18T10:31:56.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0117999999999999e-05 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds4 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.132297064999999, 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022391339999999998, 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643463+0000", 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643487+0000", 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4294000000000002e-05 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643501+0000", 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3389e-05 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643508+0000", 2024-09-18T10:31:56.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5089999999999996e-06 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643587+0000", 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9002e-05 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.643598+0000", 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0669000000000001e-05 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645670+0000", 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020720959999999998 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645702+0000", 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2438999999999999e-05 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/33 ECSubWrite(tid=87, reqid=client.4589.0:456, at_version=0'0, trim_to=0'0, roll_forward_to=56'26))", 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.656430+0000", 2024-09-18T10:31:56.826 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.119330619999999, 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069584759999999999, 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656430+0000", 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656430+0000", 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656429+0000", 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656446+0000", 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7714e-05 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656461+0000", 2024-09-18T10:31:56.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4884e-05 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656468+0000", 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1250000000000004e-06 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656533+0000", 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5114e-05 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656544+0000", 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0522e-05 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663361+0000", 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068171430000000003 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663388+0000", 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6965e-05 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 60/33 ECSubWrite(tid=72, reqid=osd.3.0:72, at_version=60'60, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.172688823, 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029421450000000002, 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603071+0000", 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603095+0000", 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3901999999999999e-05 2024-09-18T10:31:56.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603128+0000", 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2861999999999998e-05 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603135+0000", 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0180000000000004e-06 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603227+0000", 2024-09-18T10:31:56.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1874999999999997e-05 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.603237+0000", 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0370000000000001e-05 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605988+0000", 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027506900000000001 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.606014+0000", 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5664999999999999e-05 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 60/33 ECSubWrite(tid=74, reqid=osd.3.0:73, at_version=0'0, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.162704747999999, 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003567321, 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613055+0000", 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613065+0000", 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0706e-05 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613077+0000", 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613082+0000", 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.938e-06 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613129+0000", 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6600000000000001e-05 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613137+0000", 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1799999999999996e-06 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616600+0000", 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034632859999999999 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616623+0000", 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2679000000000001e-05 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 60/33 ECSubWrite(tid=75, reqid=osd.3.0:75, at_version=60'64, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:31:56.839 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613926+0000", 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.161834334, 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055868000000000003, 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613926+0000", 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613926+0000", 2024-09-18T10:31:56.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613925+0000", 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613952+0000", 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7118999999999999e-05 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613972+0000", 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0064999999999998e-05 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613990+0000", 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7569000000000001e-05 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614056+0000", 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6619999999999996e-05 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614066+0000", 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9280000000000005e-06 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619488+0000", 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054218870000000002 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619513+0000", 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4457999999999999e-05 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds4 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.601746+0000", 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.174014579, 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007718183, 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601746+0000", 2024-09-18T10:31:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601746+0000", 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601745+0000", 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601831+0000", 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5568999999999993e-05 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601846+0000", 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4661000000000001e-05 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601854+0000", 2024-09-18T10:31:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.371e-06 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601916+0000", 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1904999999999998e-05 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601931+0000", 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4762e-05 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609440+0000", 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075092149999999996 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609464+0000", 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4031000000000001e-05 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/33 ECSubWrite(tid=72, reqid=client.4589.0:492, at_version=61'52, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.17354798, 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035819210000000001, 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602212+0000", 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602266+0000", 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4305000000000003e-05 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602279+0000", 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2798e-05 2024-09-18T10:31:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602286+0000", 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0570000000000004e-06 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602357+0000", 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0517000000000003e-05 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.602368+0000", 2024-09-18T10:31:56.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1663e-05 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.605769+0000", 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003400953 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.605794+0000", 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4868e-05 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/33 ECSubWrite(tid=73, reqid=client.4589.0:493, at_version=61'53, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.603383+0000", 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.172377184, 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056686879999999999, 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603383+0000", 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603383+0000", 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603382+0000", 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603404+0000", 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1469999999999999e-05 2024-09-18T10:31:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603419+0000", 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5167999999999999e-05 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603426+0000", 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1670000000000002e-06 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603472+0000", 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5704999999999997e-05 2024-09-18T10:31:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.603482+0000", 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0536e-05 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609014+0000", 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005531757 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609052+0000", 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7796000000000002e-05 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/33 ECSubWrite(tid=74, reqid=client.4589.0:494, at_version=61'54, trim_to=0'0, roll_forward_to=49'50))", 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.604365+0000", 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.171395002000001, 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004703451, 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604365+0000", 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604365+0000", 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604364+0000", 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604386+0000", 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1209999999999999e-05 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604402+0000", 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6286999999999998e-05 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604410+0000", 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0639999999999994e-06 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604462+0000", 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2392999999999998e-05 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604474+0000", 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1552999999999999e-05 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609056+0000", 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004582526 2024-09-18T10:31:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609069+0000", 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2278e-05 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s5 71/33 ECSubWrite(tid=99, reqid=client.4589.0:574, at_version=0'0, trim_to=0'0, roll_forward_to=71'78))", 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.630968+0000", 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.144792231, 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052529339999999999, 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:31:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.630968+0000", 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.630968+0000", 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.630967+0000", 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.630978+0000", 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0560999999999999e-05 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.630991+0000", 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2593e-05 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.630997+0000", 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3679999999999998e-06 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.631074+0000", 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6686000000000004e-05 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.631084+0000", 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0744000000000001e-05 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.636200+0000", 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051151850000000004 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.636221+0000", 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1407999999999999e-05 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:31:56.865 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:31:56.866 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:56.867 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:56.867 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:56.868 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:56.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:31:56.868 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:56.869 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:56.869 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:56.869 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:56.870 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:56.870 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:56.870 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:56.865+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:56.875 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:56.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:56.890+0000 7f8abf7fe640 0 -- 172.21.15.63:0/4228224632 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7f8ac0190150 msgr2=0x7f8ac0192550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:56.893 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:56.909 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:56.909 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:56.967 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:56.967 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:56.967 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:56.966+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:56.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:31:57.068 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:57.066+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:57.071 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.071 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:31:57.169 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:57.168+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:57.176 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.176 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:31:57.269 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:57.268+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:57.295 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.295 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:31:57.370 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:57.369+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:57.403 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.403 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:31:57.471 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:31:57.470+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:31:57.509 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.509 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.518 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:31:57.572 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:57.571+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:57.591 INFO:tasks.rados.rados.0.smithi160.stdout:239: done (1 left) 2024-09-18T10:31:57.591 INFO:tasks.rados.rados.0.smithi160.stdout:240: done (0 left) 2024-09-18T10:31:57.591 INFO:tasks.rados.rados.0.smithi160.stdout:241: delete oid 1 current snap is 19 2024-09-18T10:31:57.598 INFO:tasks.rados.rados.0.smithi160.stdout:241: done (0 left) 2024-09-18T10:31:57.598 INFO:tasks.rados.rados.0.smithi160.stdout:242: copy_from oid 27 from oid 47 current snap is 19 2024-09-18T10:31:57.599 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 10 current snap is 19 2024-09-18T10:31:57.599 INFO:tasks.rados.rados.0.smithi160.stdout:243: seq_num 115 ranges {1409024=770048,2179072=704512,2883584=458752} 2024-09-18T10:31:57.610 INFO:tasks.rados.rados.0.smithi160.stdout:243: writing smithi16036501-10 from 1409024 to 2179072 tid 1 2024-09-18T10:31:57.614 INFO:tasks.rados.rados.0.smithi160.stdout:243: writing smithi16036501-10 from 2179072 to 2883584 tid 2 2024-09-18T10:31:57.617 INFO:tasks.rados.rados.0.smithi160.stdout:243: writing smithi16036501-10 from 2883584 to 3342336 tid 3 2024-09-18T10:31:57.617 INFO:tasks.rados.rados.0.smithi160.stdout:244: copy_from oid 12 from oid 2 current snap is 19 2024-09-18T10:31:57.617 INFO:tasks.rados.rados.0.smithi160.stdout:242: finishing copy_from to smithi16036501-27 2024-09-18T10:31:57.617 INFO:tasks.rados.rados.0.smithi160.stdout:242: got expected ENOENT (src dne) 2024-09-18T10:31:57.617 INFO:tasks.rados.rados.0.smithi160.stdout:242: finishing copy_from racing read to smithi16036501-27 2024-09-18T10:31:57.617 INFO:tasks.rados.rados.0.smithi160.stdout:242: done (2 left) 2024-09-18T10:31:57.618 INFO:tasks.rados.rados.0.smithi160.stdout:245: read oid 40 snap -1 2024-09-18T10:31:57.618 INFO:tasks.rados.rados.0.smithi160.stdout:245: expect (ObjNum 42 snap 0 seq_num 42) 2024-09-18T10:31:57.618 INFO:tasks.rados.rados.0.smithi160.stdout:246: delete oid 46 current snap is 19 2024-09-18T10:31:57.618 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:31:57.618 INFO:tasks.rados.rados.0.smithi160.stdout:243: finishing write tid 1 to smithi16036501-10 2024-09-18T10:31:57.622 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.622 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.622 INFO:tasks.rados.rados.0.smithi160.stdout:243: finishing write tid 2 to smithi16036501-10 2024-09-18T10:31:57.622 INFO:tasks.rados.rados.0.smithi160.stdout:246: done (3 left) 2024-09-18T10:31:57.622 INFO:tasks.rados.rados.0.smithi160.stdout:247: setattr oid 16 current snap is 19 2024-09-18T10:31:57.623 INFO:tasks.rados.rados.0.smithi160.stdout:248: read oid 31 snap 18 2024-09-18T10:31:57.623 INFO:tasks.rados.rados.0.smithi160.stdout:248: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:31:57.623 INFO:tasks.rados.rados.0.smithi160.stdout:249: rmattr oid 13 current snap is 19 2024-09-18T10:31:57.623 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 5 current snap is 19 2024-09-18T10:31:57.623 INFO:tasks.rados.rados.0.smithi160.stdout:250: seq_num 117 ranges {0=425984,425984=606208,1032192=540672,1572864=409600} 2024-09-18T10:31:57.625 INFO:tasks.rados.rados.0.smithi160.stdout:250: writing smithi16036501-5 from 0 to 425984 tid 1 2024-09-18T10:31:57.629 INFO:tasks.rados.rados.0.smithi160.stdout:250: writing smithi16036501-5 from 425984 to 1032192 tid 2 2024-09-18T10:31:57.632 INFO:tasks.rados.rados.0.smithi160.stdout:250: writing smithi16036501-5 from 1032192 to 1572864 tid 3 2024-09-18T10:31:57.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:31:57.635 INFO:tasks.rados.rados.0.smithi160.stdout:250: writing smithi16036501-5 from 1572864 to 1982464 tid 4 2024-09-18T10:31:57.635 INFO:tasks.rados.rados.0.smithi160.stdout:251: copy_from oid 43 from oid 35 current snap is 19 2024-09-18T10:31:57.635 INFO:tasks.rados.rados.0.smithi160.stdout:245: expect (ObjNum 42 snap 0 seq_num 42) 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:244: finishing copy_from racing read to smithi16036501-12 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:243: finishing write tid 3 to smithi16036501-10 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:245: done (7 left) 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:252: read oid 7 snap 18 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:252: expect (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:253: rollback oid 17 current snap is 19 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 17 to 18 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:243: finishing write tid 4 to smithi16036501-10 2024-09-18T10:31:57.656 INFO:tasks.rados.rados.0.smithi160.stdout:244: finishing copy_from to smithi16036501-12 2024-09-18T10:31:57.657 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 12 v 12 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-18T10:31:57.657 INFO:tasks.rados.rados.0.smithi160.stdout:243: finishing write tid 5 to smithi16036501-10 2024-09-18T10:31:57.657 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 10 v 103 (ObjNum 115 snap 19 seq_num 115) dirty exists 2024-09-18T10:31:57.657 INFO:tasks.rados.rados.0.smithi160.stdout:243: left oid 10 (ObjNum 115 snap 19 seq_num 115) 2024-09-18T10:31:57.657 INFO:tasks.rados.rados.0.smithi160.stdout:248: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:31:57.673 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 13 v 86 (ObjNum 62 snap 3 seq_num 62) dirty exists 2024-09-18T10:31:57.673 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 90 (ObjNum 97 snap 13 seq_num 97) dirty exists 2024-09-18T10:31:57.673 INFO:tasks.rados.rados.0.smithi160.stdout:250: finishing write tid 1 to smithi16036501-5 2024-09-18T10:31:57.673 INFO:tasks.rados.rados.0.smithi160.stdout:243: done (8 left) 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:244: done (7 left) 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:247: done (6 left) 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:248: done (5 left) 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:249: done (4 left) 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:254: copy_from oid 40 from oid 33 current snap is 19 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:250: finishing write tid 2 to smithi16036501-5 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:251: finishing copy_from racing read to smithi16036501-43 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:250: finishing write tid 3 to smithi16036501-5 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:250: finishing write tid 4 to smithi16036501-5 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:250: finishing write tid 5 to smithi16036501-5 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:251: finishing copy_from to smithi16036501-43 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 43 v 30 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:250: finishing write tid 6 to smithi16036501-5 2024-09-18T10:31:57.674 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 5 v 57 (ObjNum 117 snap 19 seq_num 117) dirty exists 2024-09-18T10:31:57.675 INFO:tasks.rados.rados.0.smithi160.stdout:250: left oid 5 (ObjNum 117 snap 19 seq_num 117) 2024-09-18T10:31:57.675 INFO:tasks.rados.rados.0.smithi160.stdout:252: expect (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:31:57.678 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:31:57.676+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:253: finishing rollback tid 0 to smithi16036501-17 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:253: finishing rollback tid 1 to smithi16036501-17 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:253: finishing rollback tid 2 to smithi16036501-17 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 80 (ObjNum 72 snap 5 seq_num 72) dirty exists 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:254: finishing copy_from to smithi16036501-40 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:254: got expected ENOENT (src dne) 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:254: finishing copy_from racing read to smithi16036501-40 2024-09-18T10:31:57.711 INFO:tasks.rados.rados.0.smithi160.stdout:250: done (4 left) 2024-09-18T10:31:57.712 INFO:tasks.rados.rados.0.smithi160.stdout:251: done (3 left) 2024-09-18T10:31:57.712 INFO:tasks.rados.rados.0.smithi160.stdout:252: done (2 left) 2024-09-18T10:31:57.712 INFO:tasks.rados.rados.0.smithi160.stdout:253: done (1 left) 2024-09-18T10:31:57.712 INFO:tasks.rados.rados.0.smithi160.stdout:254: done (0 left) 2024-09-18T10:31:57.712 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 36 current snap is 19 2024-09-18T10:31:57.712 INFO:tasks.rados.rados.0.smithi160.stdout:255: seq_num 118 ranges {1867776=442368,2310144=753664,3063808=655360,3719168=147456} 2024-09-18T10:31:57.723 INFO:tasks.rados.rados.0.smithi160.stdout:255: writing smithi16036501-36 from 1867776 to 2310144 tid 1 2024-09-18T10:31:57.727 INFO:tasks.rados.rados.0.smithi160.stdout:255: writing smithi16036501-36 from 2310144 to 3063808 tid 2 2024-09-18T10:31:57.731 INFO:tasks.rados.rados.0.smithi160.stdout:255: writing smithi16036501-36 from 3063808 to 3719168 tid 3 2024-09-18T10:31:57.732 INFO:tasks.rados.rados.0.smithi160.stdout:255: writing smithi16036501-36 from 3719168 to 3866624 tid 4 2024-09-18T10:31:57.732 INFO:tasks.rados.rados.0.smithi160.stdout:256: delete oid 32 current snap is 19 2024-09-18T10:31:57.732 INFO:tasks.rados.rados.0.smithi160.stdout:255: finishing write tid 1 to smithi16036501-36 2024-09-18T10:31:57.733 INFO:tasks.rados.rados.0.smithi160.stdout:255: finishing write tid 2 to smithi16036501-36 2024-09-18T10:31:57.736 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.736 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.741 INFO:tasks.rados.rados.0.smithi160.stdout:256: done (1 left) 2024-09-18T10:31:57.741 INFO:tasks.rados.rados.0.smithi160.stdout:257: read oid 10 snap -1 2024-09-18T10:31:57.741 INFO:tasks.rados.rados.0.smithi160.stdout:257: expect (ObjNum 115 snap 19 seq_num 115) 2024-09-18T10:31:57.741 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 37 current snap is 19 2024-09-18T10:31:57.741 INFO:tasks.rados.rados.0.smithi160.stdout:258: seq_num 120 ranges {2523136=475136,2998272=655360,3653632=622592,4276224=278528} 2024-09-18T10:31:57.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:31:57.757 INFO:tasks.rados.rados.0.smithi160.stdout:258: writing smithi16036501-37 from 2523136 to 2998272 tid 1 2024-09-18T10:31:57.761 INFO:tasks.rados.rados.0.smithi160.stdout:258: writing smithi16036501-37 from 2998272 to 3653632 tid 2 2024-09-18T10:31:57.764 INFO:tasks.rados.rados.0.smithi160.stdout:258: writing smithi16036501-37 from 3653632 to 4276224 tid 3 2024-09-18T10:31:57.766 INFO:tasks.rados.rados.0.smithi160.stdout:258: writing smithi16036501-37 from 4276224 to 4554752 tid 4 2024-09-18T10:31:57.766 INFO:tasks.rados.rados.0.smithi160.stdout:259: read oid 43 snap 18 2024-09-18T10:31:57.766 INFO:tasks.rados.rados.0.smithi160.stdout:259: expect deleted 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:260: snap_create 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:255: finishing write tid 3 to smithi16036501-36 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:255: finishing write tid 4 to smithi16036501-36 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:255: finishing write tid 5 to smithi16036501-36 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:255: finishing write tid 6 to smithi16036501-36 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 36 v 97 (ObjNum 118 snap 19 seq_num 118) dirty exists 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:255: left oid 36 (ObjNum 118 snap 19 seq_num 118) 2024-09-18T10:31:57.767 INFO:tasks.rados.rados.0.smithi160.stdout:257: expect (ObjNum 115 snap 19 seq_num 115) 2024-09-18T10:31:57.787 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:57.785+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:57.872 INFO:tasks.rados.rados.0.smithi160.stdout:258: finishing write tid 1 to smithi16036501-37 2024-09-18T10:31:57.872 INFO:tasks.rados.rados.0.smithi160.stdout:258: finishing write tid 2 to smithi16036501-37 2024-09-18T10:31:57.872 INFO:tasks.rados.rados.0.smithi160.stdout:258: finishing write tid 3 to smithi16036501-37 2024-09-18T10:31:57.872 INFO:tasks.rados.rados.0.smithi160.stdout:258: finishing write tid 4 to smithi16036501-37 2024-09-18T10:31:57.872 INFO:tasks.rados.rados.0.smithi160.stdout:258: finishing write tid 5 to smithi16036501-37 2024-09-18T10:31:57.873 INFO:tasks.rados.rados.0.smithi160.stdout:258: finishing write tid 6 to smithi16036501-37 2024-09-18T10:31:57.873 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 96 (ObjNum 120 snap 19 seq_num 120) dirty exists 2024-09-18T10:31:57.873 INFO:tasks.rados.rados.0.smithi160.stdout:258: left oid 37 (ObjNum 120 snap 19 seq_num 120) 2024-09-18T10:31:57.875 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:31:57.873+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:31:57.884 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:57.884 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:57.893 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:31:57.976 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:57.975+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:58.031 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.032 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:31:58.077 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:31:58.076+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:31:58.136 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.136 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.144 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:31:58.178 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:31:58.177+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:31:58.242 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.242 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:31:58.278 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:58.277+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.349 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:31:58.379 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:58.378+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:58.455 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.455 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.464 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:31:58.480 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:58.479+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:58.561 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.561 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:31:58.613 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:58.612+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:31:58.676 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.677 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.682 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:58.681+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:58.683 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:31:58.683 INFO:tasks.rados.rados.0.smithi160.stdout:255: done (4 left) 2024-09-18T10:31:58.683 INFO:tasks.rados.rados.0.smithi160.stdout:257: done (3 left) 2024-09-18T10:31:58.683 INFO:tasks.rados.rados.0.smithi160.stdout:258: done (2 left) 2024-09-18T10:31:58.683 INFO:tasks.rados.rados.0.smithi160.stdout:259: done (1 left) 2024-09-18T10:31:58.683 INFO:tasks.rados.rados.0.smithi160.stdout:260: done (0 left) 2024-09-18T10:31:58.683 INFO:tasks.rados.rados.0.smithi160.stdout:261: snap_remove snap 18 2024-09-18T10:31:58.686 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:31:58.783 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:58.782+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:58.824 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.824 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:31:58.884 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:31:58.883+0000 7fab6c5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 32736) UID: 0 2024-09-18T10:31:58.920 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:31:58.930 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:58.930 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:58.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:31:58.985 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:58.984+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:59.036 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:59.037 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:59.045 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:31:59.085 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:31:59.084+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:31:59.142 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:59.142 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:59.150 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:31:59.186 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:59.185+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:59.248 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:59.248 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:59.253 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:31:59.253 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:31:59.257 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:31:59.271 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:31:59.271 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:31:59.287 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:31:59.286+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:31:59.287 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:31:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:31:59.304 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:31:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:31:59.319 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:31:59.319 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:31:59.335 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:31:59.335 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:31:59.351 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:31:59.351 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:31:59.355 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:31:59.355 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:31:59.364 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:31:59.366 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:31:59.367 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:31:59.381 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:31:59.381 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:31:59.388 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:31:59.386+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:31:59.398 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:31:59.398 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:31:59.413 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:31:59.413 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:31:59.430 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:31:59.430 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:31:59.445 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:31:59.445 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:31:59.462 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:31:59.462 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:31:59.462 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:59.462 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:31:59.462 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:31:59.462 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:31:59.463 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:59.470 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:31:59.477 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:31:59.478 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:31:59.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:31:59.478+0000 7fb47ffff640 0 -- 172.21.15.63:0/3478603661 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7fb480197fb0 msgr2=0x7fb48019a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:31:59.494 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:31:59.495 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:31:59.514 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:31:59.513+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/33 ECSubWrite(tid=55, reqid=client.4589.0:200, at_version=38'19, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:31:59.571 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 36.289326780000003, 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059624359999999998, 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:31:59.572 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279560+0000", 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279841+0000", 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00028120800000000002 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.573 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279869+0000", 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7813e-05 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279894+0000", 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4644e-05 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279949+0000", 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5003999999999997e-05 2024-09-18T10:31:59.574 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279959+0000", 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0149999999999999e-05 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285495+0000", 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055354640000000004 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285524+0000", 2024-09-18T10:31:59.575 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9268000000000002e-05 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.254306361000001, 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006943187, 2024-09-18T10:31:59.576 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.577 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314581+0000", 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314602+0000", 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0686000000000002e-05 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314615+0000", 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3169e-05 2024-09-18T10:31:59.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314622+0000", 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9539999999999998e-06 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314668+0000", 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6242000000000002e-05 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.579 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314678+0000", 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5489999999999995e-06 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321509+0000", 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006831709 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321525+0000", 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5611e-05 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.580 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 56/33 ECSubWrite(tid=211, reqid=osd.4.0:211, at_version=56'58, trim_to=0'0, roll_forward_to=55'56))", 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.639261+0000", 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 18.929627188000001, 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0084968779999999994, 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639261+0000", 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.581 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639261+0000", 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639260+0000", 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.582 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639291+0000", 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0732999999999999e-05 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639302+0000", 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1214e-05 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639308+0000", 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8980000000000001e-06 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.583 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639358+0000", 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9764e-05 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639367+0000", 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.346e-06 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.647736+0000", 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0083692209999999996 2024-09-18T10:31:59.584 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.647758+0000", 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1526999999999999e-05 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.ds2 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.642890+0000", 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 18.925998494000002, 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054510069999999999, 2024-09-18T10:31:59.585 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642890+0000", 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642890+0000", 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.586 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642889+0000", 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642908+0000", 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8794e-05 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642918+0000", 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.006e-05 2024-09-18T10:31:59.587 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642923+0000", 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8040000000000001e-06 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642972+0000", 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9397000000000002e-05 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.588 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642983+0000", 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0181e-05 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.648320+0000", 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053372719999999997 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.648341+0000", 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0876000000000001e-05 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.589 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 56/33 ECSubWrite(tid=120, reqid=osd.13.0:120, at_version=56'52, trim_to=0'0, roll_forward_to=55'50))", 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.642933+0000", 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 18.925955472999998, 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053687659999999996, 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642933+0000", 2024-09-18T10:31:59.590 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642933+0000", 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642932+0000", 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.591 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642956+0000", 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3620000000000001e-05 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642963+0000", 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4950000000000002e-06 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.642972+0000", 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6349999999999995e-06 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.592 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.643042+0000", 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0104000000000005e-05 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.643053+0000", 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0458999999999999e-05 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.648281+0000", 2024-09-18T10:31:59.593 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052286549999999996 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.648301+0000", 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0128000000000001e-05 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 60/33 ECSubWrite(tid=245, reqid=osd.4.0:240, at_version=0'0, trim_to=0'0, roll_forward_to=60'66))", 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613532+0000", 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.955356011999999, 2024-09-18T10:31:59.594 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053716689999999999, 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613532+0000", 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613532+0000", 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.595 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613531+0000", 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613545+0000", 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3509999999999999e-05 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613559+0000", 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.367e-05 2024-09-18T10:31:59.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613565+0000", 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8059999999999997e-06 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613608+0000", 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2928e-05 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.597 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613619+0000", 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0661e-05 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618882+0000", 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052627020000000002 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618904+0000", 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2137000000000002e-05 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.598 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 71/33 ECSubWrite(tid=171, reqid=client.4589.0:561, at_version=71'80, trim_to=0'0, roll_forward_to=64'78))", 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.9551672820000001, 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056395589999999997, 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:31:59.599 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.600 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614490+0000", 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076972800000000001 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614504+0000", 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3468e-05 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614512+0000", 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9580000000000007e-06 2024-09-18T10:31:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614575+0000", 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2867000000000006e-05 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614607+0000", 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2053e-05 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619334+0000", 2024-09-18T10:31:59.602 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047268830000000003 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619360+0000", 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6910000000000002e-05 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=290, reqid=client.4589.0:563, at_version=71'78, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.615208+0000", 2024-09-18T10:31:59.603 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.9536804249999999, 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0064206419999999998, 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615208+0000", 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615208+0000", 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.604 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615207+0000", 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615664+0000", 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00045646 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.605 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615677+0000", 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3294e-05 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615684+0000", 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0820000000000001e-06 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615741+0000", 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7198999999999999e-05 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.606 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615754+0000", 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2418999999999999e-05 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621601+0000", 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058472519999999998 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621628+0000", 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7220999999999999e-05 2024-09-18T10:31:59.607 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=291, reqid=client.4589.0:564, at_version=71'79, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.617290+0000", 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.951598417, 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.007421548, 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.608 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617290+0000", 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617290+0000", 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617289+0000", 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.609 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617477+0000", 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00018834099999999999 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617490+0000", 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2832e-05 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617496+0000", 2024-09-18T10:31:59.610 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.767e-06 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.618868+0000", 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0013721199999999999 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.618879+0000", 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1474000000000001e-05 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.611 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624685+0000", 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058052800000000003 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624711+0000", 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6559000000000001e-05 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:568 3.es0 3:74c08199:::smithi16036501-50:head [append 0~0] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.619648+0000", 2024-09-18T10:31:59.612 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.9492396809999999, 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080131969999999997, 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 568 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619648+0000", 2024-09-18T10:31:59.613 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619648+0000", 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619646+0000", 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619659+0000", 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3079e-05 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619690+0000", 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1118000000000003e-05 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619710+0000", 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9351000000000002e-05 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.615 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619765+0000", 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5093000000000003e-05 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619869+0000", 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000104304 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.620648+0000", 2024-09-18T10:31:59.616 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000778741 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624519+0000", 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003870779 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627588+0000", 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003069441 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.617 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627662+0000", 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.3548999999999997e-05 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:569 3.es0 3:74c08199:::smithi16036501-50:head [rollback 20] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.619726+0000", 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.949161959, 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0088185109999999994, 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.618 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 569 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619726+0000", 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.619 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619726+0000", 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619725+0000", 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619730+0000", 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.4170000000000002e-06 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.620 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619736+0000", 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6400000000000002e-06 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619742+0000", 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0800000000000002e-06 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621334+0000", 2024-09-18T10:31:59.621 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0015926130000000001 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621444+0000", 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00011003899999999999 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622024+0000", 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00058015499999999995 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.622 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627329+0000", 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053043880000000002 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628492+0000", 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001162857 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628545+0000", 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3018e-05 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.623 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:570 3.es0 3:74c08199:::smithi16036501-50:head [append 0~0] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.619769+0000", 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.9491195499999998, 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0089254989999999999, 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:31:59.624 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 570 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619769+0000", 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619769+0000", 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.625 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619768+0000", 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619777+0000", 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.772e-06 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619784+0000", 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0149999999999998e-06 2024-09-18T10:31:59.626 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619794+0000", 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5910000000000002e-06 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622536+0000", 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027423529999999999 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622658+0000", 2024-09-18T10:31:59.627 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00012208799999999999 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.623133+0000", 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000474704 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627332+0000", 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041994049999999998 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:31:59.628 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628631+0000", 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0012987459999999999 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628694+0000", 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3287000000000006e-05 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=292, reqid=client.4589.0:565, at_version=71'80, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:31:59.629 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.621964+0000", 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.9469242850000001, 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080461500000000002, 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621964+0000", 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621964+0000", 2024-09-18T10:31:59.630 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621963+0000", 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622722+0000", 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00075876600000000002 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622736+0000", 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3993e-05 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622742+0000", 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7070000000000003e-06 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622788+0000", 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5753000000000001e-05 2024-09-18T10:31:59.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622795+0000", 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7299999999999999e-06 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.629982+0000", 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0071871410000000002 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.633 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.630010+0000", 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8002999999999999e-05 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=293, reqid=client.4589.0:566, at_version=71'81, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 3.9461307379999999, 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0072716869999999998, 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622768+0000", 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1386000000000001e-05 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622777+0000", 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.7509999999999997e-06 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622782+0000", 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6870000000000002e-06 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624401+0000", 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0016187910000000001 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5028000000000001e-05 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.630015+0000", 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055990279999999998 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.630029+0000", 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4486e-05 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.638 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 72/33 ECSubWrite(tid=179, reqid=osd.13.0:179, at_version=72'87, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 2.8871898229999999, 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012584682, 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.639 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681721+0000", 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3754e-05 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681731+0000", 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.8239999999999995e-06 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681744+0000", 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.223e-05 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682097+0000", 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00035303999999999999 2024-09-18T10:31:59.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682107+0000", 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0386e-05 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694258+0000", 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012150642 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694283+0000", 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5411000000000001e-05 2024-09-18T10:31:59.642 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 72/33 ECSubWrite(tid=180, reqid=osd.13.0:180, at_version=72'89, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 2.8865958159999998, 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012009316000000001, 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.643 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682313+0000", 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1603e-05 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682324+0000", 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1063000000000001e-05 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682331+0000", 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3570000000000003e-06 2024-09-18T10:31:59.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682589+0000", 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00025793399999999997 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682598+0000", 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4590000000000004e-06 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694290+0000", 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011691417000000001 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694302+0000", 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2064e-05 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 72/33 ECSubWrite(tid=313, reqid=osd.4.0:313, at_version=72'85, trim_to=0'0, roll_forward_to=71'83))", 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:31:59.647 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 2.88398691, 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010316903000000001, 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:31:59.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684921+0000", 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0237999999999998e-05 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684935+0000", 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3562e-05 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684943+0000", 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9610000000000005e-06 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684999+0000", 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6378999999999997e-05 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685011+0000", 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1377e-05 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.695187+0000", 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010176418 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.695218+0000", 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1136999999999997e-05 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.651 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 72/33 ECSubWrite(tid=315, reqid=osd.4.0:315, at_version=72'87, trim_to=0'0, roll_forward_to=71'83))", 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.685916+0000", 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 2.8829721849999999, 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011222055, 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685916+0000", 2024-09-18T10:31:59.652 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685916+0000", 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685915+0000", 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685942+0000", 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6744999999999999e-05 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685961+0000", 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9006999999999999e-05 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.654 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685968+0000", 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5340000000000002e-06 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.688738+0000", 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027699999999999999 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.655 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.688751+0000", 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2659e-05 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697111+0000", 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0083599179999999992 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697138+0000", 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7282000000000001e-05 2024-09-18T10:31:59.656 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 72/33 ECSubWrite(tid=316, reqid=client.4589.0:594, at_version=72'88, trim_to=0'0, roll_forward_to=71'83))", 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.686966+0000", 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 2.881922635, 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010191324999999999, 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.657 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686966+0000", 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686966+0000", 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686965+0000", 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686982+0000", 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7359000000000001e-05 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686996+0000", 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3774999999999999e-05 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.687001+0000", 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.293e-06 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694337+0000", 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0073363480000000003 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694348+0000", 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.039e-05 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697142+0000", 2024-09-18T10:31:59.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027944340000000002 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697157+0000", 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4583000000000001e-05 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 72/33 ECSubWrite(tid=318, reqid=osd.4.0:318, at_version=72'98, trim_to=0'0, roll_forward_to=71'96))", 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.696798+0000", 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 2.872090155, 2024-09-18T10:31:59.661 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056129020000000003, 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696798+0000", 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696798+0000", 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696797+0000", 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696823+0000", 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6525000000000001e-05 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:31:59.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696836+0000", 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2845e-05 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696853+0000", 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6663e-05 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696937+0000", 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3788000000000005e-05 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696950+0000", 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3399e-05 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.702380+0000", 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054301990000000001 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.702411+0000", 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0576e-05 2024-09-18T10:31:59.665 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.666 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.666 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.666 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:31:59.666 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:31:59.666 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:31:59.666 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:59.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:31:59.667 INFO:tasks.thrashosds.thrasher:test_bluestore_reshard started 2024-09-18T10:31:59.667 INFO:tasks.thrashosds.thrasher:Killing osd 9, live_osds are [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-18T10:31:59.667 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-09-18T10:31:59.667 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:31:59.668 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:59.666+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:59.669 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:31:59.692 INFO:tasks.rados.rados.0.smithi160.stdout:261: done (0 left) 2024-09-18T10:31:59.692 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 6 current snap is 20 2024-09-18T10:31:59.692 INFO:tasks.rados.rados.0.smithi160.stdout:262: seq_num 121 ranges {98304=491520,589824=802816,1392640=720896,2113536=32768} 2024-09-18T10:31:59.695 INFO:tasks.rados.rados.0.smithi160.stdout:262: writing smithi16036501-6 from 98304 to 589824 tid 1 2024-09-18T10:31:59.700 INFO:tasks.ceph.osd.9:Stopped 2024-09-18T10:31:59.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 9 2024-09-18T10:31:59.701 INFO:tasks.rados.rados.0.smithi160.stdout:262: writing smithi16036501-6 from 589824 to 1392640 tid 2 2024-09-18T10:31:59.704 INFO:tasks.rados.rados.0.smithi160.stdout:262: writing smithi16036501-6 from 1392640 to 2113536 tid 3 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:262: writing smithi16036501-6 from 2113536 to 2146304 tid 4 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:263: rmattr oid 9 current snap is 20 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:263: done (1 left) 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:264: rmattr oid 21 current snap is 20 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:264: done (1 left) 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 19 current snap is 20 2024-09-18T10:31:59.705 INFO:tasks.rados.rados.0.smithi160.stdout:265: seq_num 122 ranges {4030464=507904,4538368=425984,4964352=442368,5406720=540672,5947392=147456} 2024-09-18T10:31:59.729 INFO:tasks.rados.rados.0.smithi160.stdout:265: writing smithi16036501-19 from 4030464 to 4538368 tid 1 2024-09-18T10:31:59.732 INFO:tasks.rados.rados.0.smithi160.stdout:265: writing smithi16036501-19 from 4538368 to 4964352 tid 2 2024-09-18T10:31:59.735 INFO:tasks.rados.rados.0.smithi160.stdout:265: writing smithi16036501-19 from 4964352 to 5406720 tid 3 2024-09-18T10:31:59.738 INFO:tasks.rados.rados.0.smithi160.stdout:265: writing smithi16036501-19 from 5406720 to 5947392 tid 4 2024-09-18T10:31:59.739 INFO:tasks.rados.rados.0.smithi160.stdout:265: writing smithi16036501-19 from 5947392 to 6094848 tid 5 2024-09-18T10:31:59.739 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 1 to smithi16036501-19 2024-09-18T10:31:59.739 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 2 to smithi16036501-19 2024-09-18T10:31:59.739 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 38 current snap is 20 2024-09-18T10:31:59.739 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 3 to smithi16036501-19 2024-09-18T10:31:59.739 INFO:tasks.rados.rados.0.smithi160.stdout:266: seq_num 123 ranges {6062080=524288,6586368=573440,7159808=688128,7847936=294912} 2024-09-18T10:31:59.768 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:31:59.766+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:31:59.774 INFO:tasks.rados.rados.0.smithi160.stdout:266: writing smithi16036501-38 from 6062080 to 6586368 tid 1 2024-09-18T10:31:59.778 INFO:tasks.rados.rados.0.smithi160.stdout:266: writing smithi16036501-38 from 6586368 to 7159808 tid 2 2024-09-18T10:31:59.782 INFO:tasks.rados.rados.0.smithi160.stdout:266: writing smithi16036501-38 from 7159808 to 7847936 tid 3 2024-09-18T10:31:59.784 INFO:tasks.rados.rados.0.smithi160.stdout:266: writing smithi16036501-38 from 7847936 to 8142848 tid 4 2024-09-18T10:31:59.784 INFO:tasks.rados.rados.0.smithi160.stdout:267: snap_remove snap 19 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:657 3.6s0 3:6108c463:::smithi16036501-6:head [append 0~491520 in=491520b] snapc 27=[27] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.695571+0000", 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.093065525999999996, 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.093108210999999996, 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 657 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.695571+0000", 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.695571+0000", 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.695569+0000", 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.696108+0000", 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053891599999999996 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.696124+0000", 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6093999999999999e-05 2024-09-18T10:31:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.696130+0000", 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3409999999999999e-06 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.696181+0000", 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0278999999999998e-05 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:31:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.696187+0000", 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1550000000000004e-06 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.698675+0000", 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024879670000000002 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.698745+0000", 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0344000000000003e-05 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.699552+0000", 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080657600000000004 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.703513+0000", 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039607879999999998 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:658 3.6s0 3:6108c463:::smithi16036501-6:head [append 0~802816 in=802816b] snapc 27=[27] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:31:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.700031+0000", 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.088605511999999997, 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.088745196999999998, 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 658 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.700031+0000", 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.700031+0000", 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.700030+0000", 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.700786+0000", 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075596300000000001 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.700800+0000", 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4113e-05 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.700808+0000", 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8259999999999993e-06 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.701390+0000", 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00058262099999999996 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.701453+0000", 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2568000000000001e-05 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.702431+0000", 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097788100000000011 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.703908+0000", 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0014771059999999999 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:659 3.6s0 3:6108c463:::smithi16036501-6:head [append 0~720896 in=720896b] snapc 27=[27] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.704337+0000", 2024-09-18T10:31:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.084300008999999995, 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.084528851000000002, 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 659 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.704337+0000", 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.704337+0000", 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.704335+0000", 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705031+0000", 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00069598100000000003 2024-09-18T10:31:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705048+0000", 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7198e-05 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705055+0000", 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0079999999999996e-06 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705104+0000", 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8393000000000002e-05 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705211+0000", 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010743699999999999 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.706157+0000", 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094618100000000004 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.709453+0000", 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032956410000000002 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:660 3.6s0 3:6108c463:::smithi16036501-6:head [append 0~32768 in=32768b] snapc 27=[27] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.705068+0000", 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.083568927000000001, 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.083877313999999994, 2024-09-18T10:31:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 660 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705068+0000", 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705068+0000", 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705067+0000", 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705100+0000", 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2558999999999998e-05 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705112+0000", 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2672e-05 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705117+0000", 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0499999999999999e-06 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.706851+0000", 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017341609999999999 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.706979+0000", 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012714599999999999 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.707427+0000", 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044822599999999997 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.709456+0000", 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020296009999999998 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:661 3.6s0 3:6108c463:::smithi16036501-6:head [setxattr _header (56) in=63b] snapc 27=[27] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.705124+0000", 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.083513036999999998, 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.083904182999999993, 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 661 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705124+0000", 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705124+0000", 2024-09-18T10:31:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705123+0000", 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705127+0000", 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8010000000000001e-06 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705134+0000", 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2570000000000001e-06 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705138+0000", 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0860000000000004e-06 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.707962+0000", 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028234390000000001 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.708047+0000", 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5192999999999996e-05 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.708465+0000", 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041763500000000002 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.710052+0000", 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001587583 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:662 3.6s0 3:6108c463:::smithi16036501-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.705145+0000", 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.083492153, 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.083964282000000001, 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "waiting for rw locks", 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:31:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 662 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705145+0000", 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705145+0000", 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705144+0000", 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705146+0000", 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1430000000000001e-06 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705153+0000", 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9059999999999996e-06 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.705161+0000", 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5920000000000003e-06 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.708716+0000", 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035546549999999999 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.708815+0000", 2024-09-18T10:31:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9772000000000006e-05 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 6 2024-09-18T10:31:59.819 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:59.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:31:59.868 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:31:59.866+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:31:59.923 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:31:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:31:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:31:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:31:59.924 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:31:59.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:31:59.969 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:31:59.968+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:00.008 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-18T10:32:00.006+0000 7f508ddf1640 -1 mon.a@0(leader).osd e75 definitely_dead 0 2024-09-18T10:32:00.035 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:00.035 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:00.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:207 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~671744] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.758370503000002, 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011106883, 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 207 2024-09-18T10:32:00.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274787+0000", 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999962 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275694+0000", 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090683300000000001 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275721+0000", 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6876000000000002e-05 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275732+0000", 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1522000000000001e-05 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275808+0000", 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5581999999999996e-05 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275818+0000", 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0659000000000001e-05 2024-09-18T10:32:00.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278499+0000", 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026808629999999999 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278574+0000", 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4624999999999998e-05 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.279516+0000", 2024-09-18T10:32:00.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094181099999999997 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284510+0000", 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049937749999999998 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285779+0000", 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001269648 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285898+0000", 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118659 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:210 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.755654948999997, 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011901998, 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.042 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 210 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277506+0000", 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277509+0000", 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6199999999999999e-06 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277515+0000", 2024-09-18T10:32:00.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.613e-06 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277519+0000", 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.162e-06 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277555+0000", 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6918999999999997e-05 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277558+0000", 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7980000000000001e-06 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284798+0000", 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072393049999999997 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284870+0000", 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2249999999999994e-05 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287687+0000", 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028174189999999998 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287819+0000", 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013145400000000001 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289409+0000", 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015898380000000001 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:297 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~458752] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.711606474, 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0124782, 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.048 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 297 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.049 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321554+0000", 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323224+0000", 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00166989 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323245+0000", 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1603999999999998e-05 2024-09-18T10:32:00.050 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323251+0000", 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9070000000000004e-06 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323311+0000", 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9367000000000003e-05 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323391+0000", 2024-09-18T10:32:00.051 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0776e-05 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324288+0000", 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089698299999999996 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330155+0000", 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058662219999999999 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.052 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333879+0000", 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003724195 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334033+0000", 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015450800000000001 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:298 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.053 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.708917875000001, 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012910115999999999, 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 298 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:00.054 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.055 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324242+0000", 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324759+0000", 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051612499999999998 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324774+0000", 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5777000000000002e-05 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.056 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324782+0000", 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.593e-06 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325756+0000", 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097372699999999997 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.057 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325903+0000", 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014782799999999999 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326741+0000", 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083760900000000001 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330156+0000", 2024-09-18T10:32:00.058 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034153109999999999 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337078+0000", 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069219210000000002 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337154+0000", 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5430000000000001e-05 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:299 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~294912] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.706915121000002, 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01141987, 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 299 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.060 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326245+0000", 2024-09-18T10:32:00.061 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326658+0000", 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041379600000000002 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6379e-05 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.062 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326688+0000", 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3531e-05 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327587+0000", 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089865099999999999 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327696+0000", 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010859 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.063 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328440+0000", 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074455699999999997 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330157+0000", 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017169279999999999 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.064 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337590+0000", 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007433271 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337666+0000", 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5909999999999997e-05 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.065 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:300 3.6s0 3:6fd2113e:::smithi16036501-26:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.706461830999999, 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011253185000000001, 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 300 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:00.066 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326699+0000", 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.067 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326705+0000", 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4219999999999997e-06 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326713+0000", 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2179999999999999e-06 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326721+0000", 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8299999999999996e-06 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.068 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329116+0000", 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023944589999999998 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329207+0000", 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1532000000000004e-05 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329752+0000", 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00054480399999999997 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331260+0000", 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001508258 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337875+0000", 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066149590000000001 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337953+0000", 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7750000000000006e-05 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.070 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:301 3.6s0 3:6fd2113e:::smithi16036501-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.706434606999998, 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015768265, 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 301 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.071 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326726+0000", 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326729+0000", 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3189999999999999e-06 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326739+0000", 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3910000000000004e-06 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326744+0000", 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7119999999999999e-06 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330251+0000", 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003507175 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330345+0000", 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3974999999999994e-05 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338416+0000", 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080714459999999995 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338553+0000", 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013656000000000001 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342495+0000", 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003942409 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:308 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.706396339000001, 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013544333, 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 308 2024-09-18T10:32:00.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326768+0000", 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1820000000000002e-06 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326776+0000", 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5229999999999998e-06 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326781+0000", 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0950000000000003e-06 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330731+0000", 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039508199999999999 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330823+0000", 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1259000000000002e-05 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340309+0000", 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0094867969999999999 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:309 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.706375918999999, 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015227746, 2024-09-18T10:32:00.080 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 309 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326785+0000", 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326789+0000", 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7239999999999998e-06 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326797+0000", 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4100000000000008e-06 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326802+0000", 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.549e-06 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332723+0000", 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059212609999999997 2024-09-18T10:32:00.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332837+0000", 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114342 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342013+0000", 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091760220000000007 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.7s3 56/33 ECSubWrite(tid=214, reqid=osd.4.0:214, at_version=56'60, trim_to=0'0, roll_forward_to=55'56))", 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.390150814999998, 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012700209, 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.642728+0000", 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9997168 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643033+0000", 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030590899999999999 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643042+0000", 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8400000000000001e-06 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643047+0000", 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.899e-06 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644506+0000", 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001458984 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644514+0000", 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8469999999999996e-06 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655681+0000", 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011167089 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655711+0000", 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9740999999999999e-05 2024-09-18T10:32:00.088 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.fs6 56/33 ECSubWrite(tid=122, reqid=osd.13.0:122, at_version=56'54, trim_to=0'0, roll_forward_to=55'50))", 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 19.389254895000001, 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011833527999999999, 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:00.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643906+0000", 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643925+0000", 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9491999999999999e-05 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643936+0000", 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0251999999999999e-05 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643941+0000", 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5849999999999999e-06 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644566+0000", 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000624999 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644574+0000", 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1259999999999998e-06 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655717+0000", 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011142284000000001 2024-09-18T10:32:00.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655740+0000", 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3431e-05 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:493 3.6s0 3:61935b36:::smithi16036501-8:head [rollback 6] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.434161171, 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011749647, 2024-09-18T10:32:00.093 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 493 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599003+0000", 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1530000000000001e-06 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599007+0000", 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.357e-06 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599010+0000", 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9050000000000001e-06 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599162+0000", 2024-09-18T10:32:00.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151698 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599172+0000", 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0538e-05 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.602723+0000", 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003550901 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.602821+0000", 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7480999999999997e-05 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603339+0000", 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051815499999999996 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607511+0000", 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041719299999999999 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610676+0000", 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031649569999999999 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610750+0000", 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4058000000000001e-05 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.099 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:494 3.6s0 3:61935b36:::smithi16036501-8:head [append 0~0] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.434115179999999, 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014595138000000001, 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 494 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:00.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599050+0000", 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3950000000000003e-06 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599058+0000", 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.559e-06 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599061+0000", 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4120000000000001e-06 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599218+0000", 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015663600000000001 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599222+0000", 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7770000000000002e-06 2024-09-18T10:32:00.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603678+0000", 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044553229999999997 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603784+0000", 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106259 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.604317+0000", 2024-09-18T10:32:00.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053261499999999995 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607512+0000", 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003195603 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613563+0000", 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060504870000000002 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613641+0000", 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8678999999999997e-05 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:497 3.6s0 3:637715d3:::smithi16036501-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.434064206, 2024-09-18T10:32:00.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011056935, 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 497 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599101+0000", 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.895e-06 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599104+0000", 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4960000000000001e-06 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599110+0000", 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1800000000000004e-06 2024-09-18T10:32:00.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599276+0000", 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016677200000000001 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599280+0000", 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3720000000000001e-06 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606994+0000", 2024-09-18T10:32:00.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077141780000000004 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607091+0000", 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6935999999999995e-05 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610154+0000", 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030633919999999999 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:498 3.6s0 3:637715d3:::smithi16036501-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.434048037, 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015978455999999999, 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 498 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.112 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599116+0000", 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599122+0000", 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.823e-06 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599126+0000", 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7469999999999999e-06 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599303+0000", 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000176999 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599310+0000", 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5939999999999996e-06 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610213+0000", 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010902935000000001 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610306+0000", 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2299999999999994e-05 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615092+0000", 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047863489999999996 2024-09-18T10:32:00.116 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:499 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~491520] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.427256613000001, 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014076979999999999, 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605903+0000", 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606922+0000", 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010196350000000001 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606937+0000", 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.467e-05 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606944+0000", 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6379999999999998e-06 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610822+0000", 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038785320000000001 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610929+0000", 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106656 2024-09-18T10:32:00.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.612009+0000", 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001079614 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.614222+0000", 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022135829999999999 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.619906+0000", 2024-09-18T10:32:00.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056843110000000001 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.619982+0000", 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5432000000000006e-05 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:500 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~589824] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.423496557, 2024-09-18T10:32:00.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010745407, 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 500 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609664+0000", 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610170+0000", 2024-09-18T10:32:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050623900000000002 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610184+0000", 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3935e-05 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610191+0000", 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5370000000000003e-06 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615172+0000", 2024-09-18T10:32:00.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049813380000000001 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615289+0000", 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117366 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.616406+0000", 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001116391 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620060+0000", 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036545869999999999 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620328+0000", 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026800199999999999 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620410+0000", 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2047999999999998e-05 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:502 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~16384] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.419745938, 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010603589, 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 502 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613414+0000", 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613432+0000", 2024-09-18T10:32:00.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8111e-05 2024-09-18T10:32:00.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613440+0000", 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.858e-06 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613445+0000", 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3669999999999999e-06 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620505+0000", 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0070606810000000001 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620608+0000", 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102965 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621026+0000", 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000417427 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622355+0000", 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001329553 2024-09-18T10:32:00.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.623941+0000", 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015858859999999999 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624019+0000", 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7918999999999997e-05 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.134 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:503 3.6s0 3:623b1fe4:::smithi16036501-43:head [setxattr _header (57) in=7b] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.419711476, 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01079954, 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 503 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613449+0000", 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613454+0000", 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9919999999999998e-06 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613459+0000", 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.25e-06 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613461+0000", 2024-09-18T10:32:00.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.667e-06 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621427+0000", 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079660300000000007 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621541+0000", 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011382099999999999 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622066+0000", 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052472200000000004 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622656+0000", 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059010400000000004 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624184+0000", 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527736 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624250+0000", 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.58e-05 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:504 3.6s0 3:623b1fe4:::smithi16036501-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.419697426000001, 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011964740999999999, 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.140 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 504 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:00.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613465+0000", 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4899999999999999e-06 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613469+0000", 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6619999999999998e-06 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613472+0000", 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6019999999999998e-06 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622527+0000", 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090558270000000007 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:00.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622626+0000", 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8653999999999994e-05 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624532+0000", 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001906072 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624625+0000", 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2559000000000006e-05 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.625429+0000", 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080416099999999996 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.145 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:00.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:32:00.147 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:00.145+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:00.247 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:00.246+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:00.290 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:00.290 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:00.290 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:00.290 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:00.299 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:32:00.349 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:00.347+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:00.400 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:00.400 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:00.401 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:00.401 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:00.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:32:00.452 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:00.451+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:00.512 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:302 3.1s0 3:8a576e44:::smithi16036501-20:head [copy-from ver 5] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.183455163000001, 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020457712999999999, 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 302 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326556+0000", 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326570+0000", 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3662999999999999e-05 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326585+0000", 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5468000000000002e-05 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326593+0000", 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326667+0000", 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4306000000000003e-05 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1179999999999992e-06 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328239+0000", 2024-09-18T10:32:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015644680000000001 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328381+0000", 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014198999999999999 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340281+0000", 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011899197 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343588+0000", 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003307197 2024-09-18T10:32:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346944+0000", 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033560090000000001 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347016+0000", 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:32:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:303 3.1s0 3:8a576e44:::smithi16036501-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.183405905000001, 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016629574000000001, 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 303 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326607+0000", 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326611+0000", 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0389999999999998e-06 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326620+0000", 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6039999999999999e-06 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326630+0000", 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326734+0000", 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104131 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1168999999999999e-05 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328659+0000", 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018941400000000001 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5146999999999999e-05 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343012+0000", 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014297432000000001 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343114+0000", 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010218 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343237+0000", 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123347 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:306 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.183301243999999, 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014939928, 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 306 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326715+0000", 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7330000000000001e-06 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326724+0000", 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326728+0000", 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0500000000000002e-06 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326892+0000", 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016359100000000001 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326897+0000", 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5670000000000002e-06 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331380+0000", 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044830549999999997 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331488+0000", 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108174 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341652+0000", 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163635000000001 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:311 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~622592] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.172945585000001, 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266834, 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 311 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337066+0000", 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338892+0000", 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268259999999999 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338908+0000", 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5418999999999999e-05 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338972+0000", 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4393000000000005e-05 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341761+0000", 2024-09-18T10:32:00.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002788633 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341937+0000", 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017614900000000001 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343074+0000", 2024-09-18T10:32:00.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001136698 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346619+0000", 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035453020000000002 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350277+0000", 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036582979999999999 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350335+0000", 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.736e-05 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:312 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~147456] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.171028382999999, 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014117187999999999, 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.540 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 312 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:00.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338983+0000", 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339142+0000", 2024-09-18T10:32:00.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015861599999999999 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339155+0000", 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2816000000000001e-05 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339164+0000", 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1749999999999994e-06 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344524+0000", 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053596679999999997 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344614+0000", 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0613999999999997e-05 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345181+0000", 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056671599999999999 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346674+0000", 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00149266 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353034+0000", 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063603460000000002 2024-09-18T10:32:00.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353102+0000", 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8188000000000005e-05 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:313 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.170841691, 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014065207, 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.549 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 313 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339171+0000", 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339175+0000", 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5129999999999998e-06 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339186+0000", 2024-09-18T10:32:00.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339191+0000", 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1619999999999999e-06 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345694+0000", 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065030009999999996 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345792+0000", 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8045000000000001e-05 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346298+0000", 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050656699999999998 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347147+0000", 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084835599999999998 2024-09-18T10:32:00.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353189+0000", 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060422569999999997 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353237+0000", 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7890999999999999e-05 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.554 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:314 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.170816751, 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015236665999999999, 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.555 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 314 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339196+0000", 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339199+0000", 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8890000000000002e-06 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339206+0000", 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339214+0000", 2024-09-18T10:32:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1189999999999999e-06 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346686+0000", 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074727989999999996 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346756+0000", 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9511000000000006e-05 2024-09-18T10:32:00.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353571+0000", 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068155439999999998 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353677+0000", 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010571 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.354433+0000", 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075619700000000001 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:370 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~638976] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.914605509000001, 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015060278, 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.561 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 370 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595405+0000", 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596396+0000", 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099055699999999998 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596414+0000", 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8655999999999999e-05 2024-09-18T10:32:00.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596422+0000", 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596466+0000", 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4187000000000002e-05 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596471+0000", 2024-09-18T10:32:00.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2310000000000004e-06 2024-09-18T10:32:00.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598062+0000", 2024-09-18T10:32:00.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015909850000000001 2024-09-18T10:32:00.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598126+0000", 2024-09-18T10:32:00.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4302999999999997e-05 2024-09-18T10:32:00.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598945+0000", 2024-09-18T10:32:00.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081903900000000003 2024-09-18T10:32:00.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610343+0000", 2024-09-18T10:32:00.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011397243 2024-09-18T10:32:00.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610417+0000", 2024-09-18T10:32:00.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4027000000000001e-05 2024-09-18T10:32:00.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610468+0000", 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1551999999999997e-05 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:371 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~622592] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.911048616999999, 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013192463, 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 371 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598963+0000", 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599585+0000", 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000621708 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599601+0000", 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512e-05 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599608+0000", 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599960+0000", 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035244900000000001 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600065+0000", 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010497600000000001 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600996+0000", 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00093031500000000003 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612013+0000", 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011017020000000001 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612082+0000", 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8853e-05 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612157+0000", 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5618999999999995e-05 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:372 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~147456] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.910380936999999, 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012685169, 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 372 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599631+0000", 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599752+0000", 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121066 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599766+0000", 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3681e-05 2024-09-18T10:32:00.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599774+0000", 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7810000000000005e-06 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601741+0000", 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019676609999999999 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601868+0000", 2024-09-18T10:32:00.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012701100000000001 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602485+0000", 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061702700000000003 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612162+0000", 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096771410000000002 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612277+0000", 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114471 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612318+0000", 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0738000000000002e-05 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:373 3.bs0 3:d059b4f5:::smithi16036501-10:head [setxattr _header (56) in=7b] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:00.583 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.910233244, 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012671714000000001, 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 373 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599780+0000", 2024-09-18T10:32:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599783+0000", 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8829999999999999e-06 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599791+0000", 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0169999999999996e-06 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599795+0000", 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7079999999999999e-06 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603165+0000", 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033702279999999999 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603279+0000", 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000113522 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603726+0000", 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00044729299999999997 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084374069999999992 2024-09-18T10:32:00.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612407+0000", 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024380300000000001 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612452+0000", 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4453000000000003e-05 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:374 3.bs0 3:d059b4f5:::smithi16036501-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.910214096000001, 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014050109, 2024-09-18T10:32:00.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 374 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599802+0000", 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9550000000000001e-06 2024-09-18T10:32:00.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599808+0000", 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9689999999999999e-06 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599811+0000", 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6370000000000001e-06 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603965+0000", 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041538549999999997 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.604070+0000", 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104654 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612750+0000", 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086806729999999999 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612839+0000", 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8678999999999996e-05 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.613849+0000", 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010102519999999999 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:449 3.7s0 3:e76b4e45:::smithi16036501-14:head [append 0~0] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.782683108000001, 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013587101000000001, 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 449 2024-09-18T10:32:00.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727334+0000", 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727340+0000", 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6790000000000002e-06 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727349+0000", 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5289999999999997e-06 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737235+0000", 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098852860000000001 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737349+0000", 2024-09-18T10:32:00.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114485 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737818+0000", 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046887099999999999 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739481+0000", 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016627129999999999 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740836+0000", 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013552600000000001 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740917+0000", 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1295e-05 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:489 3.1s0 3:86a5dc0f:::smithi16036501-49:head [rollback 17] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.595674+0000", 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.914339244000001, 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012678340999999999, 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.602 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 489 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595674+0000", 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595674+0000", 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595670+0000", 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999957 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595678+0000", 2024-09-18T10:32:00.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9699999999999999e-06 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595685+0000", 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4039999999999998e-06 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595690+0000", 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.707e-06 2024-09-18T10:32:00.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595776+0000", 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6272000000000003e-05 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595785+0000", 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2059999999999996e-06 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598939+0000", 2024-09-18T10:32:00.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031538460000000001 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599047+0000", 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108305 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599632+0000", 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000584469 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603015+0000", 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033828700000000001 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608278+0000", 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052630730000000001 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608353+0000", 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4721000000000005e-05 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:490 3.1s0 3:86a5dc0f:::smithi16036501-49:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.914316189000001, 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012816803999999999, 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.609 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 490 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595700+0000", 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.568e-06 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595707+0000", 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5860000000000001e-06 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595711+0000", 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9720000000000003e-06 2024-09-18T10:32:00.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595822+0000", 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110819 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595830+0000", 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6910000000000003e-06 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600152+0000", 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043221630000000004 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600254+0000", 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101945 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600730+0000", 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047567799999999999 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603018+0000", 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002287472 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608447+0000", 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054292159999999997 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608514+0000", 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7257999999999999e-05 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:565 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~704512] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.8904373830000001, 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014747458999999999, 2024-09-18T10:32:00.616 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 565 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619575+0000", 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620250+0000", 2024-09-18T10:32:00.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00067491600000000001 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620264+0000", 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4566000000000001e-05 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620271+0000", 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1820000000000003e-06 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620306+0000", 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5108999999999999e-05 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620382+0000", 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6019999999999994e-05 2024-09-18T10:32:00.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.621150+0000", 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076778700000000003 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623627+0000", 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024771849999999998 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634275+0000", 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010647927999999999 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634323+0000", 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8860000000000003e-05 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:566 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (57) in=7b] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.8897325949999999, 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014199358, 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.623 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 566 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620280+0000", 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620284+0000", 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1570000000000002e-06 2024-09-18T10:32:00.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620291+0000", 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7989999999999996e-06 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620296+0000", 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3839999999999996e-06 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.621913+0000", 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001616742 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622023+0000", 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109658 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622442+0000", 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041913699999999998 2024-09-18T10:32:00.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.624407+0000", 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019650779999999999 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634418+0000", 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010010968 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634480+0000", 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2088999999999995e-05 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:567 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.889703452, 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016946042000000001, 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.629 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 567 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:00.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620309+0000", 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620312+0000", 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-06 2024-09-18T10:32:00.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620319+0000", 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.844e-06 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620323+0000", 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0180000000000003e-06 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622648+0000", 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002325063 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622738+0000", 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0117000000000005e-05 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634507+0000", 2024-09-18T10:32:00.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011768548 2024-09-18T10:32:00.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634560+0000", 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2877000000000002e-05 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.637256+0000", 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026962980000000002 2024-09-18T10:32:00.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.636 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.636 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.636 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:571 3.7s0 3:e6324555:::smithi16036501-16:head [copy-from ver 70] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:00.636 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:00.637 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.8896848840000002, 2024-09-18T10:32:00.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018763179000000001, 2024-09-18T10:32:00.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.637 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:00.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.637 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.638 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 571 2024-09-18T10:32:00.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.638 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:00.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:00.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620328+0000", 2024-09-18T10:32:00.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620334+0000", 2024-09-18T10:32:00.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.75e-06 2024-09-18T10:32:00.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620340+0000", 2024-09-18T10:32:00.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.511e-06 2024-09-18T10:32:00.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620344+0000", 2024-09-18T10:32:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9750000000000001e-06 2024-09-18T10:32:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622803+0000", 2024-09-18T10:32:00.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024588019999999999 2024-09-18T10:32:00.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622893+0000", 2024-09-18T10:32:00.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9523000000000003e-05 2024-09-18T10:32:00.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:00.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.632430+0000", 2024-09-18T10:32:00.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095375430000000008 2024-09-18T10:32:00.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:00.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634814+0000", 2024-09-18T10:32:00.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023841840000000001 2024-09-18T10:32:00.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:00.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.639038+0000", 2024-09-18T10:32:00.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042237439999999998 2024-09-18T10:32:00.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.639092+0000", 2024-09-18T10:32:00.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3718000000000003e-05 2024-09-18T10:32:00.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:572 3.7s0 3:e6324555:::smithi16036501-16:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:00.650 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 4.889664722, 2024-09-18T10:32:00.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013844128000000001, 2024-09-18T10:32:00.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:00.650 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:00.650 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:00.650 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:00.651 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:00.651 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 572 2024-09-18T10:32:00.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.651 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:00.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:00.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:00.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:00.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:00.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:00.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:00.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620348+0000", 2024-09-18T10:32:00.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:00.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:00.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620351+0000", 2024-09-18T10:32:00.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.356e-06 2024-09-18T10:32:00.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:00.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620357+0000", 2024-09-18T10:32:00.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8810000000000001e-06 2024-09-18T10:32:00.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:00.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620360+0000", 2024-09-18T10:32:00.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7450000000000001e-06 2024-09-18T10:32:00.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623121+0000", 2024-09-18T10:32:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027608300000000001 2024-09-18T10:32:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623171+0000", 2024-09-18T10:32:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0099999999999998e-05 2024-09-18T10:32:00.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:00.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.633947+0000", 2024-09-18T10:32:00.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010775389 2024-09-18T10:32:00.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:00.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634061+0000", 2024-09-18T10:32:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011421600000000001 2024-09-18T10:32:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634193+0000", 2024-09-18T10:32:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013202 2024-09-18T10:32:00.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.663 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.663 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:00.663 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:00.663 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:00.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:32:00.667 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:00.664+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:marked down osd.9. 2024-09-18T10:32:00.697 INFO:tasks.rados.rados.0.smithi160.stdout:267: done (3 left) 2024-09-18T10:32:00.697 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 46 current snap is 20 2024-09-18T10:32:00.697 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 4 to smithi16036501-19 2024-09-18T10:32:00.697 INFO:tasks.rados.rados.0.smithi160.stdout:268: seq_num 124 ranges {0=540672,540672=720896,1261568=786432,2048000=49152} 2024-09-18T10:32:00.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:32:00.701 INFO:tasks.rados.rados.0.smithi160.stdout:268: writing smithi16036501-46 from 0 to 540672 tid 1 2024-09-18T10:32:00.706 INFO:tasks.rados.rados.0.smithi160.stdout:268: writing smithi16036501-46 from 540672 to 1261568 tid 2 2024-09-18T10:32:00.710 INFO:tasks.rados.rados.0.smithi160.stdout:268: writing smithi16036501-46 from 1261568 to 2048000 tid 3 2024-09-18T10:32:00.711 INFO:tasks.rados.rados.0.smithi160.stdout:268: writing smithi16036501-46 from 2048000 to 2097152 tid 4 2024-09-18T10:32:00.711 INFO:tasks.rados.rados.0.smithi160.stdout:269: copy_from oid 8 from oid 34 current snap is 20 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 5 to smithi16036501-19 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 6 to smithi16036501-19 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:265: finishing write tid 7 to smithi16036501-19 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 63 (ObjNum 122 snap 20 seq_num 122) dirty exists 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:265: left oid 19 (ObjNum 122 snap 20 seq_num 122) 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:265: done (4 left) 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 12 current snap is 20 2024-09-18T10:32:00.712 INFO:tasks.rados.rados.0.smithi160.stdout:270: seq_num 125 ranges {32768=557056,589824=475136,1064960=507904,1572864=475136,2048000=98304} 2024-09-18T10:32:00.714 INFO:tasks.rados.rados.0.smithi160.stdout:270: writing smithi16036501-12 from 32768 to 589824 tid 1 2024-09-18T10:32:00.717 INFO:tasks.rados.rados.0.smithi160.stdout:270: writing smithi16036501-12 from 589824 to 1064960 tid 2 2024-09-18T10:32:00.719 INFO:tasks.thrashosds.thrasher:Removing osd 9, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] 2024-09-18T10:32:00.720 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 9 2024-09-18T10:32:00.720 INFO:tasks.rados.rados.0.smithi160.stdout:270: writing smithi16036501-12 from 1064960 to 1572864 tid 3 2024-09-18T10:32:00.723 INFO:tasks.rados.rados.0.smithi160.stdout:270: writing smithi16036501-12 from 1572864 to 2048000 tid 4 2024-09-18T10:32:00.724 INFO:tasks.rados.rados.0.smithi160.stdout:270: writing smithi16036501-12 from 2048000 to 2146304 tid 5 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:271: read oid 11 snap -1 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:271: expect deleted 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:272: delete oid 49 current snap is 20 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: finishing write tid 1 to smithi16036501-46 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: finishing write tid 2 to smithi16036501-46 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: finishing write tid 3 to smithi16036501-46 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: finishing write tid 4 to smithi16036501-46 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: finishing write tid 5 to smithi16036501-46 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 1 to smithi16036501-12 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: finishing write tid 6 to smithi16036501-46 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 46 v 65 (ObjNum 124 snap 20 seq_num 124) dirty exists 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:268: left oid 46 (ObjNum 124 snap 20 seq_num 124) 2024-09-18T10:32:00.725 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 2 to smithi16036501-12 2024-09-18T10:32:00.726 INFO:tasks.rados.rados.0.smithi160.stdout:268: done (6 left) 2024-09-18T10:32:00.726 INFO:tasks.rados.rados.0.smithi160.stdout:271: done (5 left) 2024-09-18T10:32:00.726 INFO:tasks.rados.rados.0.smithi160.stdout:272: done (4 left) 2024-09-18T10:32:00.726 INFO:tasks.rados.rados.0.smithi160.stdout:273: snap_create 2024-09-18T10:32:00.729 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 3 to smithi16036501-12 2024-09-18T10:32:00.729 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 4 to smithi16036501-12 2024-09-18T10:32:00.730 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 5 to smithi16036501-12 2024-09-18T10:32:00.731 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 6 to smithi16036501-12 2024-09-18T10:32:00.734 INFO:tasks.rados.rados.0.smithi160.stdout:270: finishing write tid 7 to smithi16036501-12 2024-09-18T10:32:00.734 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 12 v 71 (ObjNum 125 snap 20 seq_num 125) dirty exists 2024-09-18T10:32:00.734 INFO:tasks.rados.rados.0.smithi160.stdout:270: left oid 12 (ObjNum 125 snap 20 seq_num 125) 2024-09-18T10:32:00.766 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:00.764+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:00.808 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:00.808 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:00.808 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:00.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:32:00.866 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:00.864+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:00.962 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:00.962 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:00.962 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:00.962 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:00.962 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:00.967 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:00.966+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:00.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:32:01.049 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-18T10:32:01.047+0000 7f508ddf1640 -1 mon.a@0(leader).osd e76 definitely_dead 0 2024-09-18T10:32:01.068 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:01.067+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:01.115 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:366 3.4s0 3:2e7558df:::smithi16036501-5:head [delete] snapc d=[d,b,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.520079332999998, 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095772340000000004, 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:01.116 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 366 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593485+0000", 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593493+0000", 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9000000000000006e-06 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593511+0000", 2024-09-18T10:32:01.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8011000000000001e-05 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593517+0000", 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.781e-06 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593607+0000", 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9117999999999996e-05 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593636+0000", 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9022000000000001e-05 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594774+0000", 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001138376 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:01.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594884+0000", 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110449 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595595+0000", 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00071014400000000001 2024-09-18T10:32:01.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.598115+0000", 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0025207670000000001 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602981+0000", 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048657020000000004 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.603064+0000", 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2763999999999996e-05 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:367 3.4s0 3:22c8281c:::smithi16036501-32:head [create,setxattr nWX_d[W\\dXUWOgbXndrSbcTU`mgjR_]o\\nNcXpin (1403) in=40b,setxattr TSP[ddnm_WR]nh]QhSXpkpmmWeOP^b]baemT^Uqr (630) in=40b,setxattr R[QU^NWYrjfarmhlWmZlUkP\\ipWan`SnqZOX`VWh (806) in=40b,setxattr ]hV\\^[PQZO]n^abhilRfldoUhgtl\\\\oel`mgahd_ (3368) in=40b,setxattr OYc`XQ\\VjZfQ`]OsbemUo_mfVUSc^pNo\\[\\ldrhg (1087) in=40b,setxattr `pZtTmno_eqZOONfatgZ_`nnhemaaQWiteO]dc[V (175) in=40b,setxattr PdQa`feQapkrnjfOUYUeqsOt_hrsg\\noqrcV]pSh (981) in=40b,setxattr bk_QpaSsdlQfT`oa[pTQS_[ad]isfYm^tQNdhSiW (1718) in=40b,setxattr Ys`Y_UZ^PXhpgS`VS]`eVgkcmT^QW[aWscssRRSr (10033) in=40b,setxattr [jd]Q\\qemWTVcc`hiZnsrqrggetajZRa]\\_llS`h (1367) in=40b,setxattr `UajoeZh]tRSf\\[nnVat^TjN^_q`ooQ_br`itgZm (244) in=40b,setxattr Tng[WcWa_dsnRXtZNa^`fle`gQ___mar\\fgRsZVY (665) in=40b,setxattr nogmhepVZfQtnZc^cZSeaaogjklZkrff_Utg`UR^ (15856) in=40b,setxattr gfqSsQY[][rrac[gmaQrTSacNWttTTXhanmRa^fa (1998) in=40b,setxattr V`Y[ddb`_dfep[_]oUoTqQj\\UW[gkesnlgNPYtPa (1438) in=40b,setxattr YgoRVqUOj_mXPXsq^PdjaaolmQsTsTsZpaddktl[ (1400) in=40b,setxattr smn[QVPVkfVs]oTip]jtirOtU\\Pa\\Ym^poZgfZaq (1263) in=40b,setxattr TQSmSs^Z]\\rdosO_a^TOU^[p`jkQb`dXXh]s`Stq (909) in=40b,setxattr faPhpqVXmWh`VeNZo[b^[kYl^[[rYYPRrk_[ON`e (14664) in=40b,setxattr ksO_UmqqQefe[Q\\njt[W_roWeei`]Sn^TV]O^iSW (1963) in=40b] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.507430276000001, 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068636369999999997, 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:01.123 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 367 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606134+0000", 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606259+0000", 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012537799999999999 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606277+0000", 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7677e-05 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606284+0000", 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1629999999999999e-06 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606326+0000", 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1956000000000003e-05 2024-09-18T10:32:01.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606462+0000", 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136422 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607463+0000", 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010009730000000001 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.609207+0000", 2024-09-18T10:32:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017437399999999999 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612922+0000", 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003715281 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612999+0000", 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6951000000000002e-05 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.128 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.506615788000001, 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048843690000000004, 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:32:01.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606949+0000", 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606978+0000", 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9088e-05 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606991+0000", 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.254e-05 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606997+0000", 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999999e-06 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608218+0000", 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001220687 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608228+0000", 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0509999999999999e-05 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611809+0000", 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035805440000000002 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611834+0000", 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5670999999999999e-05 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.133 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.386996947, 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049878819999999999, 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726568+0000", 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726971+0000", 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040273199999999999 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727008+0000", 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7058999999999999e-05 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727018+0000", 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4960000000000002e-06 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727105+0000", 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7641999999999999e-05 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727116+0000", 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0288e-05 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731541+0000", 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044253809999999999 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731557+0000", 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5767e-05 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.384680029999998, 2024-09-18T10:32:01.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063305380000000001, 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728885+0000", 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728993+0000", 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108399 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.140 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729010+0000", 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6674999999999999e-05 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729017+0000", 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4760000000000001e-06 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729076+0000", 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8768999999999999e-05 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729087+0000", 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0370999999999999e-05 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735190+0000", 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061034770000000004 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735216+0000", 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6321000000000001e-05 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.383918350999998, 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075128, 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.143 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729647+0000", 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729962+0000", 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031509799999999998 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729974+0000", 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2442999999999999e-05 2024-09-18T10:32:01.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729985+0000", 2024-09-18T10:32:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0778000000000001e-05 2024-09-18T10:32:01.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730933+0000", 2024-09-18T10:32:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094732900000000001 2024-09-18T10:32:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730946+0000", 2024-09-18T10:32:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2981e-05 2024-09-18T10:32:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737129+0000", 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061833449999999998 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737160+0000", 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1452000000000003e-05 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.149 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.382701972, 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063226910000000001, 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.150 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:32:01.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730879+0000", 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6008e-05 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730889+0000", 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6860000000000001e-06 2024-09-18T10:32:01.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730894+0000", 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6339999999999998e-06 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731351+0000", 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000456577 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731360+0000", 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0520000000000007e-06 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737174+0000", 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058143250000000004 2024-09-18T10:32:01.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737187+0000", 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2310000000000001e-05 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:01.156 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.470352156000001, 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056619699999999997, 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643213+0000", 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643236+0000", 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3031999999999999e-05 2024-09-18T10:32:01.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643245+0000", 2024-09-18T10:32:01.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6619999999999994e-06 2024-09-18T10:32:01.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.160 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643251+0000", 2024-09-18T10:32:01.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8529999999999997e-06 2024-09-18T10:32:01.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643299+0000", 2024-09-18T10:32:01.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7874000000000003e-05 2024-09-18T10:32:01.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643308+0000", 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4390000000000006e-06 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648839+0000", 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055302210000000001 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648876+0000", 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7181999999999997e-05 2024-09-18T10:32:01.163 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 56/33 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.467297085999999, 2024-09-18T10:32:01.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047824060000000003, 2024-09-18T10:32:01.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.165 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.165 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.165 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:01.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.166 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.166 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:01.166 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3662000000000001e-05 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646306+0000", 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3517e-05 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646316+0000", 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8239999999999995e-06 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646393+0000", 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7268999999999995e-05 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646403+0000", 2024-09-18T10:32:01.169 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0475999999999999e-05 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651027+0000", 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004623963 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651051+0000", 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3972e-05 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.466912505, 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066185949999999997, 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.172 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646674+0000", 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1492e-05 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646686+0000", 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1752e-05 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646692+0000", 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0260000000000004e-06 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646751+0000", 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9382000000000002e-05 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646762+0000", 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1042e-05 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.174 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653246+0000", 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064839570000000003 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653272+0000", 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5605999999999998e-05 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.175 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/33 ECSubWrite(tid=85, reqid=client.4589.0:456, at_version=56'26, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.649420+0000", 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.464146245999999, 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038659559999999998, 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649420+0000", 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649420+0000", 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649419+0000", 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649586+0000", 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016696300000000001 2024-09-18T10:32:01.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649602+0000", 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6538999999999999e-05 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649609+0000", 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7059999999999998e-06 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649675+0000", 2024-09-18T10:32:01.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5672000000000004e-05 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.649684+0000", 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8410000000000006e-06 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653276+0000", 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003592638 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653286+0000", 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4830000000000005e-06 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=95, reqid=client.4589.0:487, at_version=60'41, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.512364651999999, 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.009354111, 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:01.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601216+0000", 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5795e-05 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601228+0000", 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1372999999999999e-05 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601234+0000", 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.178e-06 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601802+0000", 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056782999999999996 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601812+0000", 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.027e-05 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610535+0000", 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087234549999999998 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610555+0000", 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=96, reqid=osd.5.0:96, at_version=60'43, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.511503271999999, 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085102259999999992, 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602062+0000", 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602086+0000", 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.393e-05 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602098+0000", 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1949e-05 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602104+0000", 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3740000000000003e-06 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602590+0000", 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048540399999999999 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602599+0000", 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2029999999999998e-06 2024-09-18T10:32:01.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610562+0000", 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079633459999999996 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610573+0000", 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0791000000000001e-05 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.510529007999999, 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067723929999999998, 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603070+0000", 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2941999999999997e-05 2024-09-18T10:32:01.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603082+0000", 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2391e-05 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603088+0000", 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3280000000000002e-06 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603148+0000", 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0093000000000002e-05 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603159+0000", 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0217999999999999e-05 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609781+0000", 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066224500000000002 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609809+0000", 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8194000000000001e-05 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=97, reqid=osd.5.0:97, at_version=60'45, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.509083490999998, 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061409799999999999, 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.194 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:01.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604503+0000", 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1679e-05 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604516+0000", 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2172e-05 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604522+0000", 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2430000000000002e-06 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604689+0000", 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166928 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604699+0000", 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0586e-05 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610607+0000", 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059073229999999999 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610623+0000", 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6792000000000001e-05 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 16.502204391999999, 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058420499999999997, 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611361+0000", 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611370+0000", 2024-09-18T10:32:01.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1959999999999997e-06 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611381+0000", 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1175000000000001e-05 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611386+0000", 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6059999999999996e-06 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.201 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611448+0000", 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1869e-05 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611457+0000", 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6609999999999995e-06 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617180+0000", 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057225189999999997 2024-09-18T10:32:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617204+0000", 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3652e-05 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.511914076, 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004305578, 2024-09-18T10:32:01.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601777+0000", 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012559 2024-09-18T10:32:01.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601798+0000", 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1138999999999999e-05 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601809+0000", 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1069e-05 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601881+0000", 2024-09-18T10:32:01.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2056000000000003e-05 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601892+0000", 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605917+0000", 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040245489999999997 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605957+0000", 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0605999999999997e-05 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 75/33 ECSubWrite(tid=118, reqid=client.4589.0:666, at_version=75'61, trim_to=0'0, roll_forward_to=75'60))", 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:59.739732+0000", 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.373833619, 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003879614, 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.208 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.739732+0000", 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.739732+0000", 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.739732+0000", 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.740275+0000", 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00054348199999999997 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.740294+0000", 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8884000000000001e-05 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.740301+0000", 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4089999999999997e-06 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.740348+0000", 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6519e-05 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.740359+0000", 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1399e-05 2024-09-18T10:32:01.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.743585+0000", 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032259860000000001 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:59.743612+0000", 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6673e-05 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 76/33 ECSubWrite(tid=123, reqid=osd.5.0:123, at_version=76'65, trim_to=0'0, roll_forward_to=75'63))", 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:00.698957+0000", 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.41460923599999999, 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050509930000000001, 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698957+0000", 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698957+0000", 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698956+0000", 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698980+0000", 2024-09-18T10:32:01.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.425e-05 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698996+0000", 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5675000000000002e-05 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.699004+0000", 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.554e-06 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.699074+0000", 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0403999999999999e-05 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.699085+0000", 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1555e-05 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.703976+0000", 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048903879999999999 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704008+0000", 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1786999999999999e-05 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 76/33 ECSubWrite(tid=124, reqid=osd.5.0:123, at_version=0'0, trim_to=0'0, roll_forward_to=76'65))", 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:00.704379+0000", 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.40918650000000001, 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055344549999999998, 2024-09-18T10:32:01.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704379+0000", 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704379+0000", 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704378+0000", 2024-09-18T10:32:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.219 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704391+0000", 2024-09-18T10:32:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2644e-05 2024-09-18T10:32:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704419+0000", 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7798e-05 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704426+0000", 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0010000000000004e-06 2024-09-18T10:32:01.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704477+0000", 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0766000000000001e-05 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704488+0000", 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1351e-05 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.709877+0000", 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053894370000000004 2024-09-18T10:32:01.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.709914+0000", 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6557000000000003e-05 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.225 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.225 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.225 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:01.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:32:01.228 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:01.226+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:01.327 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:01.326+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:01.370 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:01.370 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:01.370 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:01.370 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:01.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:32:01.428 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:01.427+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:01.481 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:01.481 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:01.481 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:01.481 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:01.481 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:01.489 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:32:01.506 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:32:01.530 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:01.528+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:01.630 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:01.628+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.038285895000001, 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045952509999999998, 2024-09-18T10:32:01.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597803+0000", 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597814+0000", 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1413999999999999e-05 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597824+0000", 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6989999999999998e-06 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597830+0000", 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9839999999999998e-06 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597886+0000", 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6334e-05 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597895+0000", 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5599999999999994e-06 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602372+0000", 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044773520000000004 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602399+0000", 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6472e-05 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:32:01.643 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.029099748, 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047167229999999999, 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606989+0000", 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607014+0000", 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4873999999999999e-05 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607029+0000", 2024-09-18T10:32:01.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5136e-05 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607036+0000", 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7340000000000002e-06 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607236+0000", 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020045800000000001 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607246+0000", 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.009e-05 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611683+0000", 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044365819999999997 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611706+0000", 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3509000000000001e-05 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.029027811999999, 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046098479999999997, 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607061+0000", 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607083+0000", 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1835999999999999e-05 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607093+0000", 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9049999999999992e-06 2024-09-18T10:32:01.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607100+0000", 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2450000000000001e-06 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607147+0000", 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7092999999999998e-05 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607154+0000", 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5799999999999997e-06 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611645+0000", 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044915099999999998 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611671+0000", 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6421999999999999e-05 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.034755482000001, 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010486074, 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:01.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601333+0000", 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601448+0000", 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115426 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601462+0000", 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3579e-05 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601469+0000", 2024-09-18T10:32:01.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0530000000000001e-06 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601650+0000", 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000181273 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601659+0000", 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3739999999999998e-06 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611795+0000", 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010135877999999999 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611820+0000", 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5400000000000001e-05 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.033484736999998, 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095436749999999997, 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602604+0000", 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602653+0000", 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8948e-05 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602666+0000", 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2779000000000001e-05 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602674+0000", 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3210000000000005e-06 2024-09-18T10:32:01.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602759+0000", 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5636999999999993e-05 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602770+0000", 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0465000000000001e-05 2024-09-18T10:32:01.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612126+0000", 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093557369999999994 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612148+0000", 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2736000000000001e-05 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 27.032327346999999, 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084016750000000008, 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603761+0000", 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603784+0000", 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2696000000000001e-05 2024-09-18T10:32:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603798+0000", 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4199000000000001e-05 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603805+0000", 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6200000000000001e-06 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603872+0000", 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7512e-05 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603883+0000", 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729e-05 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612153+0000", 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082698349999999997 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.078e-05 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.909148925, 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065126710000000003, 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726940+0000", 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727360+0000", 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041924799999999999 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727372+0000", 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2152e-05 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727379+0000", 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8730000000000001e-06 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727436+0000", 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7802e-05 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727446+0000", 2024-09-18T10:32:01.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2520000000000005e-06 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733427+0000", 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059812659999999998 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733453+0000", 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6302e-05 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.90710383, 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075586109999999998, 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728985+0000", 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729148+0000", 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016313100000000001 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729165+0000", 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7489000000000001e-05 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729182+0000", 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6079999999999999e-05 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729230+0000", 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8004000000000003e-05 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729240+0000", 2024-09-18T10:32:01.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0327e-05 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736514+0000", 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072737649999999997 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736544+0000", 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0602000000000003e-05 2024-09-18T10:32:01.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.905061714999999, 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055584830000000003, 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731027+0000", 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731125+0000", 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8250000000000003e-05 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731138+0000", 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3022e-05 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731146+0000", 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.571e-06 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731229+0000", 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3368999999999994e-05 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731239+0000", 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5880000000000004e-06 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736576+0000", 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053372209999999996 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736586+0000", 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0389e-05 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.681 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 21.904929074000002, 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054374030000000004, 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731178+0000", 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8043999999999999e-05 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731187+0000", 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0189999999999995e-06 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731193+0000", 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6169999999999998e-06 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731650+0000", 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045705799999999999 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731659+0000", 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4630000000000007e-06 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736588+0000", 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004929124 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736598+0000", 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5089999999999999e-06 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=212, reqid=osd.4.0:212, at_version=56'57, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.996328237, 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046823120000000001, 2024-09-18T10:32:01.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639788+0000", 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6826999999999999e-05 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639799+0000", 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1231e-05 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639805+0000", 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6290000000000004e-06 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639867+0000", 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1551999999999996e-05 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639877+0000", 2024-09-18T10:32:01.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0308e-05 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644419+0000", 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045418610000000003 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644444+0000", 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4377999999999999e-05 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=215, reqid=client.4589.0:459, at_version=56'59, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.992643013999999, 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048391809999999997, 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643445+0000", 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643467+0000", 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1481e-05 2024-09-18T10:32:01.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643482+0000", 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4612e-05 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643490+0000", 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2150000000000001e-06 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643544+0000", 2024-09-18T10:32:01.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4302000000000003e-05 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643556+0000", 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2136999999999999e-05 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648259+0000", 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047024700000000003 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648286+0000", 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6923999999999998e-05 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=216, reqid=client.4589.0:460, at_version=56'60, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.992328281999999, 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045387350000000003, 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643788+0000", 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7053e-05 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643797+0000", 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5810000000000003e-06 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643803+0000", 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6590000000000004e-06 2024-09-18T10:32:01.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644611+0000", 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080760000000000001 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644619+0000", 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7770000000000008e-06 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648290+0000", 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003670539 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648300+0000", 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9699999999999994e-06 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.699 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 56/33 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.989797253999999, 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040949139999999998, 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646313+0000", 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.128e-05 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646325+0000", 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1494e-05 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646335+0000", 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0295999999999999e-05 2024-09-18T10:32:01.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646388+0000", 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3362999999999997e-05 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646396+0000", 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8180000000000004e-06 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.703 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650347+0000", 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039510020000000003 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.650387+0000", 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9885000000000002e-05 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:32:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.989389927000001, 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045182080000000001, 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:32:01.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646699+0000", 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646718+0000", 2024-09-18T10:32:01.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646728+0000", 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4690000000000003e-06 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646733+0000", 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5550000000000002e-06 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646780+0000", 2024-09-18T10:32:01.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6839000000000003e-05 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646789+0000", 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651195+0000", 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044061660000000004 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.708 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651218+0000", 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2518999999999999e-05 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=92, reqid=client.4589.0:485, at_version=60'39, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.038125032, 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041052750000000002, 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597989+0000", 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598002+0000", 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2218999999999999e-05 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598008+0000", 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8430000000000004e-06 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598070+0000", 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1849999999999999e-05 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598082+0000", 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602043+0000", 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039603920000000001 2024-09-18T10:32:01.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602070+0000", 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7098999999999999e-05 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=93, reqid=client.4589.0:486, at_version=60'40, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.036779897999999, 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046809249999999998, 2024-09-18T10:32:01.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599309+0000", 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599330+0000", 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1630000000000001e-05 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599366+0000", 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5364000000000002e-05 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599374+0000", 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1799999999999996e-06 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599422+0000", 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7868000000000003e-05 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599432+0000", 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8409999999999995e-06 2024-09-18T10:32:01.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603965+0000", 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045336689999999997 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603990+0000", 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5258000000000001e-05 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.717 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 17.024719962999999, 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051192939999999999, 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611380+0000", 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611392+0000", 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611399+0000", 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1130000000000003e-06 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611450+0000", 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0590000000000002e-05 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611461+0000", 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0616e-05 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616457+0000", 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049963660000000003 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616489+0000", 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1863999999999998e-05 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 65/33 ECSubWrite(tid=107, reqid=client.4589.0:543, at_version=65'52, trim_to=0'0, roll_forward_to=64'51))", 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 11.974572883, 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047841719999999997, 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661516+0000", 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662367+0000", 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000850492 2024-09-18T10:32:01.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662384+0000", 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6991e-05 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662391+0000", 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1709999999999996e-06 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662450+0000", 2024-09-18T10:32:01.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8943999999999997e-05 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662462+0000", 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2033e-05 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666279+0000", 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038165149999999999 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666301+0000", 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 71/33 ECSubWrite(tid=306, reqid=client.4589.0:587, at_version=71'95, trim_to=0'0, roll_forward_to=71'93))", 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.9396948119999999, 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047899739999999998, 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:01.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696394+0000", 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:01.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696497+0000", 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103317 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696511+0000", 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4279e-05 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696524+0000", 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2311e-05 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696574+0000", 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0018999999999997e-05 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696580+0000", 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3419999999999996e-06 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.701169+0000", 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045889149999999998 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.701185+0000", 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5775999999999999e-05 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:01.730 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:01.731 INFO:tasks.rados.rados.0.smithi160.stdout:270: done (4 left) 2024-09-18T10:32:01.732 INFO:tasks.rados.rados.0.smithi160.stdout:273: done (3 left) 2024-09-18T10:32:01.732 INFO:tasks.rados.rados.0.smithi160.stdout:274: snap_remove snap 20 2024-09-18T10:32:01.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:32:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:marked out osd.9. 2024-09-18T10:32:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:32:01.734 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.9 2024-09-18T10:32:01.735 INFO:tasks.thrashosds.thrasher:remote for osd 9 is ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:32:01.735 DEBUG:teuthology.orchestra.run.smithi071:> type ceph-objectstore-tool 2024-09-18T10:32:01.735 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:01.731+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:01.753 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-18T10:32:01.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal --op list-pgs 2024-09-18T10:32:01.836 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:01.835+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:01.845 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:01.846 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:01.846 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:01.846 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:01.853 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:01.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:32:01.871 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:01.871 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:01.887 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:01.887 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:01.904 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:01.904 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:01.919 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:01.919 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:01.934 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:01.932+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:01.935 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:01.936 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:01.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:32:01.945+0000 7f68d9c16200 -1 bluestore::NCB::__restore_allocator::No Valid allocation info on disk (empty file) 2024-09-18T10:32:01.952 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:01.952 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:01.969 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:01.969 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:01.983 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:01.993 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:01.993 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.000 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:02.000 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:02.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:32:02.017 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:02.032 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:02.032 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:02.034 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:02.033+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:02.048 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:02.048 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:02.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:32:02.047+0000 7f47f37fe640 0 -- 172.21.15.63:0/1218218381 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7f47f41902b0 msgr2=0x7f47f4192690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:32:02.065 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:02.065 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:02.082 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:02.085 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:02.085 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:02.099 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.099 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:32:02.135 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:02.134+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:02.206 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.207 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:32:02.235 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:02.234+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:02.321 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.321 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:32:02.373 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:02.372+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:02.427 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.428 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:32:02.437 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:02.435+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:02.538 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:02.537+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:02.574 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.574 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:274: done (3 left) 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:275: read oid 35 snap -1 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:275: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:276: rollback oid 40 current snap is 21 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:276: done (4 left) 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:277: rollback oid 24 current snap is 21 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:277: done (4 left) 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:278: copy_from oid 4 from oid 18 current snap is 21 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:279: read oid 7 snap -1 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:279: expect (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:32:02.594 INFO:tasks.rados.rados.0.smithi160.stdout:280: rollback oid 44 current snap is 21 2024-09-18T10:32:02.595 INFO:tasks.rados.rados.0.smithi160.stdout:280: done (6 left) 2024-09-18T10:32:02.595 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 26 current snap is 21 2024-09-18T10:32:02.595 INFO:tasks.rados.rados.0.smithi160.stdout:281: seq_num 127 ranges {4538368=589824,5128192=753664,5881856=475136,6356992=327680} 2024-09-18T10:32:02.624 INFO:tasks.rados.rados.0.smithi160.stdout:281: writing smithi16036501-26 from 4538368 to 5128192 tid 1 2024-09-18T10:32:02.628 INFO:tasks.rados.rados.0.smithi160.stdout:281: writing smithi16036501-26 from 5128192 to 5881856 tid 2 2024-09-18T10:32:02.631 INFO:tasks.rados.rados.0.smithi160.stdout:281: writing smithi16036501-26 from 5881856 to 6356992 tid 3 2024-09-18T10:32:02.633 INFO:tasks.rados.rados.0.smithi160.stdout:281: writing smithi16036501-26 from 6356992 to 6684672 tid 4 2024-09-18T10:32:02.633 INFO:tasks.rados.rados.0.smithi160.stdout:282: snap_create 2024-09-18T10:32:02.633 INFO:tasks.rados.rados.0.smithi160.stdout:275: expect (ObjNum 34 snap 0 seq_num 34) 2024-09-18T10:32:02.639 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:02.638+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:02.656 INFO:tasks.rados.rados.0.smithi160.stdout:278: finishing copy_from racing read to smithi16036501-4 2024-09-18T10:32:02.656 INFO:tasks.rados.rados.0.smithi160.stdout:278: finishing copy_from to smithi16036501-4 2024-09-18T10:32:02.656 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 4 v 39 (ObjNum 99 snap 14 seq_num 99) dirty exists 2024-09-18T10:32:02.657 INFO:tasks.rados.rados.0.smithi160.stdout:269: finishing copy_from to smithi16036501-8 2024-09-18T10:32:02.657 INFO:tasks.rados.rados.0.smithi160.stdout:269: got expected ENOENT (src dne) 2024-09-18T10:32:02.657 INFO:tasks.rados.rados.0.smithi160.stdout:269: finishing copy_from racing read to smithi16036501-8 2024-09-18T10:32:02.657 INFO:tasks.rados.rados.0.smithi160.stdout:279: expect (ObjNum 63 snap 3 seq_num 63) 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: finishing write tid 1 to smithi16036501-6 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: finishing write tid 2 to smithi16036501-6 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: finishing write tid 3 to smithi16036501-6 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: finishing write tid 4 to smithi16036501-6 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: finishing write tid 5 to smithi16036501-6 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: finishing write tid 6 to smithi16036501-6 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 6 v 95 (ObjNum 121 snap 20 seq_num 121) dirty exists 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:262: left oid 6 (ObjNum 121 snap 20 seq_num 121) 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:281: finishing write tid 1 to smithi16036501-26 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:281: finishing write tid 2 to smithi16036501-26 2024-09-18T10:32:02.698 INFO:tasks.rados.rados.0.smithi160.stdout:281: finishing write tid 3 to smithi16036501-26 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:281: finishing write tid 4 to smithi16036501-26 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:281: finishing write tid 5 to smithi16036501-26 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: finishing write tid 1 to smithi16036501-38 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:281: finishing write tid 6 to smithi16036501-26 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 26 v 100 (ObjNum 127 snap 21 seq_num 127) dirty exists 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:281: left oid 26 (ObjNum 127 snap 21 seq_num 127) 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: finishing write tid 2 to smithi16036501-38 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: finishing write tid 3 to smithi16036501-38 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: finishing write tid 4 to smithi16036501-38 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: finishing write tid 5 to smithi16036501-38 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: finishing write tid 6 to smithi16036501-38 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 88 (ObjNum 123 snap 20 seq_num 123) dirty exists 2024-09-18T10:32:02.699 INFO:tasks.rados.rados.0.smithi160.stdout:266: left oid 38 (ObjNum 123 snap 20 seq_num 123) 2024-09-18T10:32:02.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:32:02.722+0000 7f68d9c16200 -1 bluestore::NCB::__restore_allocator::No Valid allocation info on disk (empty file) 2024-09-18T10:32:02.730 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.730 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:32:02.740 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:02.739+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:02.836 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.836 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.840 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:02.839+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:02.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:32:02.941 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:02.940+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:02.949 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:02.949 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:02.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:32:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:3.ds4 2024-09-18T10:32:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:3.5s3 2024-09-18T10:32:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:3.6s5 2024-09-18T10:32:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:3.3s1 2024-09-18T10:32:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:3.0s2 2024-09-18T10:32:02.993 INFO:teuthology.orchestra.run.smithi071.stdout:2.0 2024-09-18T10:32:03.041 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:03.040+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:03.056 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.056 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:32:03.142 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:03.140+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:03.164 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.164 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:32:03.244 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:03.243+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:03.309 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.309 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.317 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:32:03.345 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:03.344+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:03.414 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.414 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:32:03.446 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:03.444+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:03.516 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal --op export --pgid 3.6s5 --file /var/log/ceph/exp.3.6s5.9 2024-09-18T10:32:03.520 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.520 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.529 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:32:03.546 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:03.546+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:03.599 INFO:tasks.rados.rados.0.smithi160.stdout:262: done (7 left) 2024-09-18T10:32:03.599 INFO:tasks.rados.rados.0.smithi160.stdout:266: done (6 left) 2024-09-18T10:32:03.599 INFO:tasks.rados.rados.0.smithi160.stdout:269: done (5 left) 2024-09-18T10:32:03.599 INFO:tasks.rados.rados.0.smithi160.stdout:275: done (4 left) 2024-09-18T10:32:03.600 INFO:tasks.rados.rados.0.smithi160.stdout:278: done (3 left) 2024-09-18T10:32:03.600 INFO:tasks.rados.rados.0.smithi160.stdout:279: done (2 left) 2024-09-18T10:32:03.600 INFO:tasks.rados.rados.0.smithi160.stdout:281: done (1 left) 2024-09-18T10:32:03.600 INFO:tasks.rados.rados.0.smithi160.stdout:282: done (0 left) 2024-09-18T10:32:03.600 INFO:tasks.rados.rados.0.smithi160.stdout:283: snap_remove snap 21 2024-09-18T10:32:03.629 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.629 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:32:03.682 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:03.681+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:03.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:32:03.736 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.736 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:32:03.748 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:03.747+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:03.849 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:03.847+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:03.883 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:03.883 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:03.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:32:03.950 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:03.949+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:04.030 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:04.030 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:04.038 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:32:04.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:32:04.049+0000 7f2c61d39640 0 --2- 172.21.15.63:0/2098287549 >> v2:172.21.15.63:3300/0 conn(0x7f2c5c155510 0x7f2c5c0c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-18T10:32:04.050 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:04.049+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:04.086 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:32:04.134 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:04.134 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:04.142 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:32:04.151 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:04.150+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:04.209 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:04.210 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:04.226 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:04.226 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:04.240 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:04.240 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:04.241 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:04.241 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:04.248 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:32:04.252 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:04.251+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:04.257 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:04.273 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:04.289 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:04.304 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:04.305 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:04.320 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:04.320 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:04.335 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:04.351 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:04.351 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:04.352 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:04.351+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:04.358 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:04.358 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:04.358 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:32:04.359 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:04.367 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:04.367 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:04.368 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:32:04.381 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:04.382 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:04.397 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:04.412 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:04.413 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:04.428 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:04.428 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:04.430 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:04.431 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:04.453 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:04.452+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:04.468 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:04.468 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:04.468 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:32:04.468 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:32:04.468 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:04.476 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:32:04.555 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:04.554+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:04.598 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:32:04.599 INFO:tasks.rados.rados.0.smithi160.stdout:283: done (0 left) 2024-09-18T10:32:04.599 INFO:tasks.rados.rados.0.smithi160.stdout:284: snap_create 2024-09-18T10:32:04.619 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.es5 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.303227448999998, 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010619747000000001, 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.620 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.621 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314194+0000", 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9682000000000001e-05 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314208+0000", 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4456e-05 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314216+0000", 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4039999999999998e-06 2024-09-18T10:32:04.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314276+0000", 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0130000000000002e-05 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314307+0000", 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0667999999999998e-05 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324753+0000", 2024-09-18T10:32:04.623 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010446057999999999 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324784+0000", 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1608e-05 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.624 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.2s1 44/33 ECSubWrite(tid=11, reqid=osd.14.0:11, at_version=44'10, trim_to=0'0, roll_forward_to=42'8))", 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.302512487000001, 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010009494000000001, 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.625 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314896+0000", 2024-09-18T10:32:04.626 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7241e-05 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314908+0000", 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1807000000000001e-05 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314914+0000", 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6470000000000003e-06 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.627 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314993+0000", 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9171999999999993e-05 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315014+0000", 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1325999999999999e-05 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324876+0000", 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.009861692 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.628 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324889+0000", 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2867000000000001e-05 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=73, reqid=osd.13.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.301757403000003, 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0092378719999999994, 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.629 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.630 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315646+0000", 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2227e-05 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315665+0000", 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9485999999999999e-05 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315676+0000", 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1144e-05 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315894+0000", 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000217343 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.316163+0000", 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00026891000000000003 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.632 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324826+0000", 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086628130000000001 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324872+0000", 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6819e-05 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=74, reqid=client.4589.0:278, at_version=44'22, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:32:04.633 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.298193806, 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091122809999999999, 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:32:04.634 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319197+0000", 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319499+0000", 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00030185299999999998 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.635 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319516+0000", 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7447000000000001e-05 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319524+0000", 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8560000000000007e-06 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319581+0000", 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6787999999999999e-05 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.636 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319590+0000", 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2150000000000007e-06 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328264+0000", 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086732709999999998 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328310+0000", 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6757e-05 2024-09-18T10:32:04.637 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s3 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:32:04.638 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.296463825000004, 2024-09-18T10:32:04.639 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013131472, 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320927+0000", 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320950+0000", 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2860000000000001e-05 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320963+0000", 2024-09-18T10:32:04.641 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3281999999999999e-05 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320970+0000", 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.815e-06 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321072+0000", 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000101679 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321082+0000", 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0112000000000001e-05 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334037+0000", 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012954979 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334060+0000", 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2616000000000002e-05 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.643 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:285 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~442368] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.294371761999997, 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013315863000000001, 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 285 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.644 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323018+0000", 2024-09-18T10:32:04.645 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323786+0000", 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076849899999999996 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323806+0000", 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9749999999999999e-05 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323816+0000", 2024-09-18T10:32:04.646 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.91e-06 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326375+0000", 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025593740000000001 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326486+0000", 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000110361 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.647 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328927+0000", 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024414390000000001 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334196+0000", 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052685989999999997 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336273+0000", 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020772350000000002 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.648 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336336+0000", 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2928999999999993e-05 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:286 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~720896] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.288684152999998, 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080273050000000002, 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 286 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:32:04.650 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328706+0000", 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329422+0000", 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00071608700000000002 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.651 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329439+0000", 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6762e-05 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329444+0000", 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2220000000000001e-06 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330184+0000", 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074012100000000005 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.652 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330295+0000", 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000111335 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331780+0000", 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001484899 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334386+0000", 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0026057580000000001 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.653 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336669+0000", 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002283532 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336735+0000", 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5593999999999996e-05 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.654 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:288 3.0s0 3:02ffc1f8:::smithi16036501-17:head [setxattr _header (56) in=7b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.287908813000001, 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0084205180000000001, 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 288 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.655 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.656 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329485+0000", 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.813e-06 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329489+0000", 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3639999999999999e-06 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329491+0000", 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1789999999999998e-06 2024-09-18T10:32:04.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334535+0000", 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050437019999999997 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335074+0000", 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00053956900000000005 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335709+0000", 2024-09-18T10:32:04.658 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00063488599999999998 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337448+0000", 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001738945 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337849+0000", 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040134200000000001 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.659 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337904+0000", 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4129000000000003e-05 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:289 3.0s0 3:02ffc1f8:::smithi16036501-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 35.287898319, 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0097207330000000005, 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.660 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 289 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.661 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329493+0000", 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329495+0000", 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.376e-06 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329498+0000", 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6380000000000002e-06 2024-09-18T10:32:04.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329501+0000", 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2670000000000001e-06 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337024+0000", 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075235809999999997 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337080+0000", 2024-09-18T10:32:04.663 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5986999999999998e-05 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338204+0000", 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001123476 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338288+0000", 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4359999999999999e-05 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.664 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.339214+0000", 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000926333 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:415 3.0s0 3:0a6b7166:::smithi16036501-28:head [append 0~0] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 25.988432457999998, 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079305439999999994, 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.665 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 415 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:04.666 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628962+0000", 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4690000000000002e-06 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.667 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628969+0000", 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9720000000000003e-06 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628973+0000", 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9740000000000004e-06 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629040+0000", 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6503999999999999e-05 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.668 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629043+0000", 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1329999999999999e-06 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633315+0000", 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042715519999999996 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633399+0000", 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4252999999999994e-05 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.669 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633789+0000", 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00039028199999999999 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636113+0000", 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002324062 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636794+0000", 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00068055999999999998 2024-09-18T10:32:04.670 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636890+0000", 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6304999999999994e-05 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:422 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~737280] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.967471648, 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010997704000000001, 2024-09-18T10:32:04.671 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 422 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.672 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.673 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649918+0000", 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650522+0000", 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00060473000000000005 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650543+0000", 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0928999999999999e-05 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.674 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650551+0000", 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9699999999999999e-06 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650611+0000", 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0090000000000002e-05 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op must wait for map", 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650621+0000", 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6739999999999992e-06 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.675 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.652641+0000", 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020202430000000001 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.652748+0000", 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000106977 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654248+0000", 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001500028 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.676 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660764+0000", 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006516127 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660831+0000", 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6540999999999999e-05 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660918+0000", 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6994000000000001e-05 2024-09-18T10:32:04.677 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:423 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~573440] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.964227807, 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0093190359999999993, 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.678 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 423 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.679 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653163+0000", 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653853+0000", 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00069050600000000002 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653868+0000", 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.524e-05 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.680 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653879+0000", 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0584999999999999e-05 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.656943+0000", 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003063985 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657047+0000", 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103649 2024-09-18T10:32:04.681 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657886+0000", 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00083983699999999996 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661372+0000", 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034854690000000002 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662421+0000", 2024-09-18T10:32:04.682 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001048736 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662483+0000", 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2453999999999995e-05 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:424 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~196608] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.962382067, 2024-09-18T10:32:04.683 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096355950000000003, 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 424 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.684 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655009+0000", 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655125+0000", 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000116648 2024-09-18T10:32:04.685 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655139+0000", 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3869000000000001e-05 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655146+0000", 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0360000000000001e-06 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658784+0000", 2024-09-18T10:32:04.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036375840000000001 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658889+0000", 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00010497600000000001 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.659461+0000", 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00057189199999999995 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661374+0000", 2024-09-18T10:32:04.687 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001913849 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664576+0000", 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003202004 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664645+0000", 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9060999999999995e-05 2024-09-18T10:32:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:425 3.0s0 3:0d48e6bb:::smithi16036501-38:head [setxattr _header (57) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.962238538000001, 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096364109999999992, 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.689 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 425 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.690 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655156+0000", 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5190000000000001e-06 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655163+0000", 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3759999999999996e-06 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.691 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655167+0000", 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9400000000000004e-06 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.659827+0000", 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046608539999999999 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660123+0000", 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00029602200000000001 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.692 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660525+0000", 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040106499999999998 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662166+0000", 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001641595 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664727+0000", 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025612529999999999 2024-09-18T10:32:04.693 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664790+0000", 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2372000000000005e-05 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:426 3.0s0 3:0d48e6bb:::smithi16036501-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.962221243999998, 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011075404, 2024-09-18T10:32:04.694 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 426 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.695 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655170+0000", 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655178+0000", 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8469999999999996e-06 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.696 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655185+0000", 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7510000000000002e-06 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655189+0000", 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9570000000000004e-06 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661136+0000", 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059469930000000002 2024-09-18T10:32:04.697 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661287+0000", 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00015076999999999999 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.665373+0000", 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0040862720000000002 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.665456+0000", 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2935000000000005e-05 2024-09-18T10:32:04.698 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.666246+0000", 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00079023899999999998 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 72/33 ECSubWrite(tid=180, reqid=osd.13.0:180, at_version=72'89, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.682261+0000", 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 7.9351310030000004, 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0090984340000000007, 2024-09-18T10:32:04.699 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682261+0000", 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682261+0000", 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.700 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682260+0000", 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682299+0000", 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9246000000000003e-05 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682310+0000", 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0407999999999999e-05 2024-09-18T10:32:04.701 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682316+0000", 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6289999999999998e-06 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682356+0000", 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0219999999999998e-05 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682365+0000", 2024-09-18T10:32:04.702 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.7110000000000007e-06 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691333+0000", 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0089679970000000001 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691359+0000", 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5879000000000001e-05 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.703 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s5 72/33 ECSubWrite(tid=314, reqid=osd.4.0:314, at_version=72'56, trim_to=0'0, roll_forward_to=71'54))", 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 7.9308790680000003, 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.008363021, 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.704 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686536+0000", 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3281e-05 2024-09-18T10:32:04.705 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686545+0000", 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1870000000000003e-06 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686550+0000", 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4940000000000003e-06 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686714+0000", 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000163246 2024-09-18T10:32:04.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686727+0000", 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2813000000000001e-05 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694852+0000", 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0081255919999999992 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694876+0000", 2024-09-18T10:32:04.707 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3723999999999999e-05 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 75/33 ECSubWrite(tid=198, reqid=osd.13.0:198, at_version=75'99, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.9092649860000002, 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0090926070000000008, 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.708 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:04.709 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708140+0000", 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3557000000000001e-05 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708150+0000", 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5179999999999993e-06 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708162+0000", 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1956e-05 2024-09-18T10:32:04.710 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708280+0000", 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000118056 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708290+0000", 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9199999999999999e-06 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717185+0000", 2024-09-18T10:32:04.711 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0088948619999999999 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717220+0000", 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4869000000000001e-05 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 75/33 ECSubWrite(tid=199, reqid=osd.13.0:199, at_version=75'101, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.9081973009999995, 2024-09-18T10:32:04.712 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0085760149999999993, 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.713 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709194+0000", 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709214+0000", 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0176000000000001e-05 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709225+0000", 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1260999999999999e-05 2024-09-18T10:32:04.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709232+0000", 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.263e-06 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709775+0000", 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00054309200000000001 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709784+0000", 2024-09-18T10:32:04.715 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2660000000000007e-06 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717744+0000", 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079602270000000003 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717771+0000", 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6372000000000001e-05 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.716 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s5 75/33 ECSubWrite(tid=345, reqid=osd.4.0:345, at_version=75'60, trim_to=0'0, roll_forward_to=73'58))", 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710127+0000", 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.9072653329999998, 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0076564620000000002, 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710127+0000", 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.717 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710127+0000", 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710126+0000", 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710145+0000", 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9440999999999999e-05 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.718 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710158+0000", 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2308e-05 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710164+0000", 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.9900000000000002e-06 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710209+0000", 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5089999999999997e-05 2024-09-18T10:32:04.719 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710219+0000", 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0131e-05 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717760+0000", 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075410290000000003 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717783+0000", 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3195000000000001e-05 2024-09-18T10:32:04.720 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.721 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.721 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.721 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:04.721 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:04.721 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:04.723 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:32:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:Exporting 3.6s5 info 3.6s5( v 73'87 (0'0,73'87] local-lis/les=33/34 n=7 ec=33/33 lis/c=33/33 les/c/f=34/34/0 sis=33) 2024-09-18T10:32:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:6108c463:::smithi16036501-6:head# 2024-09-18T10:32:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:61935b36:::smithi16036501-8:head# 2024-09-18T10:32:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:61b75516:::smithi16036501-13:26# 2024-09-18T10:32:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:61b75516:::smithi16036501-13:head# 2024-09-18T10:32:04.724 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:623b1fe4:::smithi16036501-43:head# 2024-09-18T10:32:04.725 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:637715d3:::smithi16036501-41:head# 2024-09-18T10:32:04.725 INFO:teuthology.orchestra.run.smithi071.stderr:Read 5#3:6fd2113e:::smithi16036501-26:head# 2024-09-18T10:32:04.725 INFO:teuthology.orchestra.run.smithi071.stderr:Export successful 2024-09-18T10:32:04.725 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:04.721+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:04.824 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:04.823+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:04.824 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:04.824 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:04.824 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:32:04.824 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:04.833 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:32:04.925 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:04.923+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:04.930 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:04.930 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:04.930 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:32:04.930 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:32:04.930 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:04.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:32:05.026 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:05.025+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:05.037 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.037 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:32:05.037 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:32:05.037 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:32:05.037 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.440205051, 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039367780000000002, 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.038 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.039 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595358+0000", 2024-09-18T10:32:05.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.040 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.040 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595367+0000", 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6660000000000003e-06 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595378+0000", 2024-09-18T10:32:05.041 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0883999999999999e-05 2024-09-18T10:32:05.042 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.042 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595384+0000", 2024-09-18T10:32:05.042 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5659999999999997e-06 2024-09-18T10:32:05.042 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.043 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.043 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.043 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595422+0000", 2024-09-18T10:32:05.043 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8557999999999999e-05 2024-09-18T10:32:05.043 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.043 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.044 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.044 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.595434+0000", 2024-09-18T10:32:05.044 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1573000000000001e-05 2024-09-18T10:32:05.044 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.044 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.044 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599270+0000", 2024-09-18T10:32:05.045 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038357019999999999 2024-09-18T10:32:05.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.045 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.045 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599295+0000", 2024-09-18T10:32:05.046 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5622999999999998e-05 2024-09-18T10:32:05.046 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.046 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.046 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.046 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.047 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 49/33 ECSubWrite(tid=41, reqid=osd.3.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=49'29))", 2024-09-18T10:32:05.047 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:05.047 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.431531112999998, 2024-09-18T10:32:05.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056101689999999999, 2024-09-18T10:32:05.047 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.047 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.048 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.048 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.048 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.048 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:05.048 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:05.049 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604042+0000", 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0319999999999999e-05 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.050 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604052+0000", 2024-09-18T10:32:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6830000000000003e-06 2024-09-18T10:32:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.052 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:32:05.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2500000000000003e-06 2024-09-18T10:32:05.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.053 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.053 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604104+0000", 2024-09-18T10:32:05.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5391e-05 2024-09-18T10:32:05.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.054 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604112+0000", 2024-09-18T10:32:05.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6780000000000006e-06 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609618+0000", 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055057309999999998 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.055 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.056 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.056 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609643+0000", 2024-09-18T10:32:05.056 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4572000000000001e-05 2024-09-18T10:32:05.056 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.056 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.056 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.057 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.057 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.057 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 49/33 ECSubWrite(tid=169, reqid=osd.4.0:168, at_version=0'0, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:32:05.057 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:32:05.057 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.431127181000001, 2024-09-18T10:32:05.057 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051417169999999996, 2024-09-18T10:32:05.058 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.058 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.058 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.058 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.058 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.058 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:32:05.059 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.059 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.059 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.059 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.059 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:32:05.059 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.060 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.060 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.060 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.060 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604435+0000", 2024-09-18T10:32:05.060 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.060 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.061 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.061 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.061 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604448+0000", 2024-09-18T10:32:05.061 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2131e-05 2024-09-18T10:32:05.061 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.061 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604459+0000", 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1649e-05 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.062 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604466+0000", 2024-09-18T10:32:05.063 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4799999999999998e-06 2024-09-18T10:32:05.063 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.063 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.063 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.063 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604513+0000", 2024-09-18T10:32:05.063 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7036999999999997e-05 2024-09-18T10:32:05.064 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.064 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.064 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.064 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604523+0000", 2024-09-18T10:32:05.064 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0118999999999999e-05 2024-09-18T10:32:05.064 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.065 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.065 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.065 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609552+0000", 2024-09-18T10:32:05.065 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050292749999999997 2024-09-18T10:32:05.065 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.065 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.066 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.066 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609578+0000", 2024-09-18T10:32:05.066 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5811000000000001e-05 2024-09-18T10:32:05.066 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.066 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.067 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.067 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.067 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.067 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=31, reqid=osd.8.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:32:05.067 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:32:05.067 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.430993041000001, 2024-09-18T10:32:05.068 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055933889999999998, 2024-09-18T10:32:05.068 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.068 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.068 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.068 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.068 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.069 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:32:05.069 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.069 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.069 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.069 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.069 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:32:05.070 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.070 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.070 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.070 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.070 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604569+0000", 2024-09-18T10:32:05.070 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.071 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.071 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.071 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.071 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604584+0000", 2024-09-18T10:32:05.071 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5183e-05 2024-09-18T10:32:05.071 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.072 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.072 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.072 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604599+0000", 2024-09-18T10:32:05.072 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4738e-05 2024-09-18T10:32:05.072 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.072 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.073 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.073 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604606+0000", 2024-09-18T10:32:05.073 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8390000000000001e-06 2024-09-18T10:32:05.073 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.073 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.073 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.074 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604658+0000", 2024-09-18T10:32:05.074 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2009000000000003e-05 2024-09-18T10:32:05.074 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.074 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.074 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.074 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604667+0000", 2024-09-18T10:32:05.075 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4269999999999997e-06 2024-09-18T10:32:05.075 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.075 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.075 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.075 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610148+0000", 2024-09-18T10:32:05.075 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054800889999999996 2024-09-18T10:32:05.076 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.076 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.076 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.076 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610164+0000", 2024-09-18T10:32:05.076 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6271999999999999e-05 2024-09-18T10:32:05.076 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.077 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.077 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.077 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.077 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.077 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:05.077 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:32:05.078 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.428733220000002, 2024-09-18T10:32:05.078 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054572869999999999, 2024-09-18T10:32:05.078 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.078 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.078 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.078 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.079 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.079 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:32:05.079 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.079 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.079 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.079 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.080 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:32:05.080 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.080 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.080 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.080 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.081 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606829+0000", 2024-09-18T10:32:05.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.081 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.081 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.081 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606859+0000", 2024-09-18T10:32:05.082 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9223000000000001e-05 2024-09-18T10:32:05.082 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.082 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.082 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.082 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606874+0000", 2024-09-18T10:32:05.083 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 2024-09-18T10:32:05.083 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.083 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.083 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.083 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606880+0000", 2024-09-18T10:32:05.083 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5400000000000001e-06 2024-09-18T10:32:05.084 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.084 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.084 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.084 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606942+0000", 2024-09-18T10:32:05.084 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1527999999999998e-05 2024-09-18T10:32:05.084 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.085 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.085 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.085 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606952+0000", 2024-09-18T10:32:05.085 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0139999999999999e-05 2024-09-18T10:32:05.085 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.086 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.086 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.086 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612246+0000", 2024-09-18T10:32:05.086 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052944999999999997 2024-09-18T10:32:05.086 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.086 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.087 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.087 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612288+0000", 2024-09-18T10:32:05.087 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1016000000000002e-05 2024-09-18T10:32:05.087 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.087 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.087 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.088 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.088 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.088 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=32, reqid=client.4589.0:367, at_version=49'24, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:32:05.088 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:05.088 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.428062051000001, 2024-09-18T10:32:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051511930000000001, 2024-09-18T10:32:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.089 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.090 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:05.090 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.090 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.090 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.090 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.091 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:05.091 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.091 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.091 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.091 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.091 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:05.092 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.092 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.092 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.092 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.092 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607667+0000", 2024-09-18T10:32:05.092 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000166269 2024-09-18T10:32:05.093 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.093 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.093 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.093 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607677+0000", 2024-09-18T10:32:05.093 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.397e-06 2024-09-18T10:32:05.094 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.094 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.094 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.094 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607681+0000", 2024-09-18T10:32:05.094 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2139999999999998e-06 2024-09-18T10:32:05.095 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.095 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.095 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.095 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607714+0000", 2024-09-18T10:32:05.095 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3355999999999997e-05 2024-09-18T10:32:05.095 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.096 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.096 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.096 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607723+0000", 2024-09-18T10:32:05.096 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9719999999999998e-06 2024-09-18T10:32:05.096 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.097 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.097 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.097 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612630+0000", 2024-09-18T10:32:05.097 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049068009999999997 2024-09-18T10:32:05.097 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.097 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.098 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.098 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612653+0000", 2024-09-18T10:32:05.098 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2731999999999999e-05 2024-09-18T10:32:05.098 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.098 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.099 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.099 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.099 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.099 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 55/33 ECSubWrite(tid=57, reqid=client.4589.0:424, at_version=55'46, trim_to=0'0, roll_forward_to=54'40))", 2024-09-18T10:32:05.099 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.660367+0000", 2024-09-18T10:32:05.099 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 25.375196714000001, 2024-09-18T10:32:05.100 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0039998530000000003, 2024-09-18T10:32:05.100 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.100 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.100 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.100 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.100 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.101 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660367+0000", 2024-09-18T10:32:05.101 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.101 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.101 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.101 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.101 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660367+0000", 2024-09-18T10:32:05.102 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.102 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.102 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.102 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.102 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660366+0000", 2024-09-18T10:32:05.103 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.103 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.103 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.103 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.103 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660425+0000", 2024-09-18T10:32:05.104 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8897000000000002e-05 2024-09-18T10:32:05.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.104 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.104 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.104 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660439+0000", 2024-09-18T10:32:05.104 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4412e-05 2024-09-18T10:32:05.105 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.105 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.105 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.105 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660445+0000", 2024-09-18T10:32:05.105 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0390000000000001e-06 2024-09-18T10:32:05.105 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.106 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.106 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.106 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660492+0000", 2024-09-18T10:32:05.106 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7225000000000003e-05 2024-09-18T10:32:05.106 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660503+0000", 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0788000000000001e-05 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664344+0000", 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038410739999999999 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.107 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664367+0000", 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2399e-05 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 55/33 ECSubWrite(tid=77, reqid=client.4589.0:450, at_version=55'32, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 25.254971802, 2024-09-18T10:32:05.108 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046866, 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.109 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781300+0000", 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00070876399999999997 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781311+0000", 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0360000000000001e-05 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.110 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781316+0000", 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.0529999999999997e-06 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781356+0000", 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9888000000000002e-05 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781362+0000", 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8820000000000003e-06 2024-09-18T10:32:05.111 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.785253+0000", 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038900670000000001 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.785278+0000", 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5712e-05 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.112 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 56/33 ECSubWrite(tid=45, reqid=osd.8.0:45, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.397281613000001, 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003599859, 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.113 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638282+0000", 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638294+0000", 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1929e-05 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.114 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638301+0000", 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1949999999999997e-06 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638305+0000", 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2039999999999999e-06 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638361+0000", 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5498999999999998e-05 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.115 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.638373+0000", 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2071e-05 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.641856+0000", 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003482958 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.641882+0000", 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6115e-05 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.116 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 56/33 ECSubWrite(tid=63, reqid=osd.3.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=56'51))", 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.395215394000001, 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042165529999999996, 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.117 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640347+0000", 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1082e-05 2024-09-18T10:32:05.118 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640372+0000", 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3559e-05 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640378+0000", 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5209999999999999e-06 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640427+0000", 2024-09-18T10:32:05.119 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8717999999999997e-05 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640438+0000", 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0793e-05 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.644544+0000", 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041064129999999997 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.644565+0000", 2024-09-18T10:32:05.120 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0265999999999999e-05 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 60/33 ECSubWrite(tid=74, reqid=osd.3.0:73, at_version=0'0, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 20.422548814999999, 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051941000000000001, 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.121 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613014+0000", 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.122 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613026+0000", 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2536e-05 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613041+0000", 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4487999999999999e-05 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613065+0000", 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4145e-05 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.123 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613135+0000", 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0297999999999997e-05 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613145+0000", 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0288999999999999e-05 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618182+0000", 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050361340000000003 2024-09-18T10:32:05.124 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618209+0000", 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7146000000000001e-05 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 60/33 ECSubWrite(tid=75, reqid=osd.3.0:75, at_version=60'64, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 20.421712395, 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0043719620000000001, 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.125 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.126 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613850+0000", 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613869+0000", 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9038999999999998e-05 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613882+0000", 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2539e-05 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.127 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613888+0000", 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.806e-06 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613928+0000", 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0584000000000003e-05 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613936+0000", 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9219999999999997e-06 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.128 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618212+0000", 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042758199999999996 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618223+0000", 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1009000000000001e-05 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 71/33 ECSubWrite(tid=299, reqid=client.4589.0:576, at_version=71'52, trim_to=0'0, roll_forward_to=69'49))", 2024-09-18T10:32:05.129 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.654955+0000", 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.3806082279999998, 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042654620000000002, 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.654955+0000", 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.654955+0000", 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.130 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.654954+0000", 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655481+0000", 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00052745099999999996 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655496+0000", 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4426e-05 2024-09-18T10:32:05.131 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655504+0000", 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9370000000000004e-06 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655557+0000", 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3276000000000003e-05 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655569+0000", 2024-09-18T10:32:05.132 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1773999999999999e-05 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.659199+0000", 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036300949999999998 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.659221+0000", 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1736999999999999e-05 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.133 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 72/33 ECSubWrite(tid=90, reqid=osd.3.0:90, at_version=72'76, trim_to=0'0, roll_forward_to=71'74))", 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.3541310769999999, 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0098813010000000003, 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.134 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681546+0000", 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000113816 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.135 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681559+0000", 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3448999999999999e-05 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681567+0000", 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.7209999999999994e-06 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681664+0000", 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6910000000000006e-05 2024-09-18T10:32:05.136 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681675+0000", 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1195999999999999e-05 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691281+0000", 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096056779999999994 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691314+0000", 2024-09-18T10:32:05.137 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2826e-05 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 72/33 ECSubWrite(tid=314, reqid=osd.4.0:314, at_version=72'56, trim_to=0'0, roll_forward_to=71'54))", 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.3508370290000009, 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0094518429999999997, 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.138 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.139 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684742+0000", 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6058000000000001e-05 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684754+0000", 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1542000000000001e-05 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.140 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684761+0000", 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.3000000000000004e-06 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684836+0000", 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4505999999999994e-05 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684858+0000", 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2286e-05 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.141 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694149+0000", 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0092913449999999995 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694178+0000", 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8975e-05 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.142 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 75/33 ECSubWrite(tid=99, reqid=osd.3.0:99, at_version=75'82, trim_to=0'0, roll_forward_to=73'80))", 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.707719+0000", 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.3278448489999999, 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096391459999999995, 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707719+0000", 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707719+0000", 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707718+0000", 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707736+0000", 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8108999999999999e-05 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.144 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707747+0000", 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0796e-05 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707756+0000", 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4330000000000004e-06 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707803+0000", 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7726999999999999e-05 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707814+0000", 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0535e-05 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717317+0000", 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0095034339999999998 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717358+0000", 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0374999999999999e-05 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 75/33 ECSubWrite(tid=345, reqid=osd.4.0:345, at_version=75'60, trim_to=0'0, roll_forward_to=73'58))", 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.3254740739999997, 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0078501869999999998, 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710107+0000", 2024-09-18T10:32:05.148 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.772e-05 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710115+0000", 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9270000000000005e-06 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710119+0000", 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.301e-06 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.149 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710162+0000", 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3102999999999997e-05 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710175+0000", 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2765000000000001e-05 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717919+0000", 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0077437189999999996 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.150 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717940+0000", 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0812e-05 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 75/33 ECSubWrite(tid=113, reqid=osd.5.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=75'56))", 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710325+0000", 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.3252386569999999, 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070424759999999998, 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.151 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710325+0000", 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710325+0000", 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710324+0000", 2024-09-18T10:32:05.152 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710335+0000", 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0583e-05 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710349+0000", 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4076999999999999e-05 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710355+0000", 2024-09-18T10:32:05.153 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0079999999999999e-06 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710409+0000", 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3871e-05 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710422+0000", 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3739e-05 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.154 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717350+0000", 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0069278009999999999 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717367+0000", 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7127999999999999e-05 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 75/33 ECSubWrite(tid=71, reqid=osd.8.0:70, at_version=0'0, trim_to=0'0, roll_forward_to=75'61))", 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.713760+0000", 2024-09-18T10:32:05.155 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.3218035859999997, 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042101150000000004, 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713760+0000", 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713760+0000", 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.156 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713759+0000", 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713769+0000", 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0199e-05 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713781+0000", 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2334000000000001e-05 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713787+0000", 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4929999999999998e-06 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713820+0000", 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3549e-05 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713827+0000", 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5810000000000002e-06 2024-09-18T10:32:05.158 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717948+0000", 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004121268 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717970+0000", 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1795000000000001e-05 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.159 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 75/33 ECSubWrite(tid=114, reqid=client.4589.0:663, at_version=75'58, trim_to=0'0, roll_forward_to=75'56))", 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.731399+0000", 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.3041642769999999, 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004059455, 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731399+0000", 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.160 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731399+0000", 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731398+0000", 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731897+0000", 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00049827400000000005 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.161 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731908+0000", 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1831000000000001e-05 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731913+0000", 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7149999999999997e-06 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731951+0000", 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7755e-05 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.162 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731958+0000", 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7120000000000003e-06 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.735437+0000", 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034797740000000001 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.735459+0000", 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1208000000000001e-05 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.163 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.164 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.164 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.164 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:05.165 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:32:05.166 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:05.164+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:05.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal --force --op remove --pgid 3.6s5 2024-09-18T10:32:05.263 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.263 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:05.264 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:32:05.264 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:05.266 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:05.264+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:05.273 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:32:05.366 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:05.365+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:05.370 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.371 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:05.371 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:32:05.371 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:32:05.371 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:05.379 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:32:05.468 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:05.467+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:05.478 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.478 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:32:05.478 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/33 ECSubWrite(tid=55, reqid=client.4589.0:200, at_version=38'19, trim_to=0'0, roll_forward_to=36'16))", 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 42.197127017, 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059624359999999998, 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.479 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279561+0000", 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279560+0000", 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.480 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279841+0000", 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00028120800000000002 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279869+0000", 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7813e-05 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279894+0000", 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4644e-05 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.481 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279949+0000", 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5003999999999997e-05 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.279959+0000", 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0149999999999999e-05 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285495+0000", 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055354640000000004 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.482 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:23.285524+0000", 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9268000000000002e-05 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 36.162106598000001, 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006943187, 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.483 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314582+0000", 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.484 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314581+0000", 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314602+0000", 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0686000000000002e-05 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314615+0000", 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3169e-05 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.485 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314622+0000", 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9539999999999998e-06 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314668+0000", 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6242000000000002e-05 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314678+0000", 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5489999999999995e-06 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321509+0000", 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006831709 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321525+0000", 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5611e-05 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.487 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 56/33 ECSubWrite(tid=211, reqid=osd.4.0:211, at_version=56'58, trim_to=0'0, roll_forward_to=55'56))", 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.639261+0000", 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 24.837427425000001, 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0084968779999999994, 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.488 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639261+0000", 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639261+0000", 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639260+0000", 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.489 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639291+0000", 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0732999999999999e-05 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639302+0000", 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1214e-05 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639308+0000", 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.8980000000000001e-06 2024-09-18T10:32:05.490 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639358+0000", 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9764e-05 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.639367+0000", 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.346e-06 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.647736+0000", 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0083692209999999996 2024-09-18T10:32:05.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.647758+0000", 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1526999999999999e-05 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 71/33 ECSubWrite(tid=171, reqid=client.4589.0:561, at_version=71'80, trim_to=0'0, roll_forward_to=64'78))", 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8629675189999997, 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056395589999999997, 2024-09-18T10:32:05.492 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.493 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.613721+0000", 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614490+0000", 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076972800000000001 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614504+0000", 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3468e-05 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.494 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614512+0000", 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9580000000000007e-06 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614575+0000", 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2867000000000006e-05 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.614607+0000", 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2053e-05 2024-09-18T10:32:05.495 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619334+0000", 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047268830000000003 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619360+0000", 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6910000000000002e-05 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.496 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=290, reqid=client.4589.0:563, at_version=71'78, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.615208+0000", 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.861480662, 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0064206419999999998, 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615208+0000", 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.497 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615208+0000", 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615207+0000", 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615664+0000", 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00045646 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.498 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615677+0000", 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3294e-05 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615684+0000", 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0820000000000001e-06 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615741+0000", 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.7198999999999999e-05 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.499 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.615754+0000", 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2418999999999999e-05 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621601+0000", 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058472519999999998 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621628+0000", 2024-09-18T10:32:05.500 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7220999999999999e-05 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=291, reqid=client.4589.0:564, at_version=71'79, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.617290+0000", 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8593986539999996, 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.007421548, 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.501 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617290+0000", 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617290+0000", 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617289+0000", 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.502 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617477+0000", 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00018834099999999999 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617490+0000", 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2832e-05 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.617496+0000", 2024-09-18T10:32:05.503 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.767e-06 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.618868+0000", 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0013721199999999999 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.618879+0000", 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1474000000000001e-05 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.504 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624685+0000", 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058052800000000003 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624711+0000", 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6559000000000001e-05 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:568 3.es0 3:74c08199:::smithi16036501-50:head [append 0~0] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:05.505 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.619648+0000", 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8570399179999999, 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080131969999999997, 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 568 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619648+0000", 2024-09-18T10:32:05.506 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619648+0000", 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619646+0000", 2024-09-18T10:32:05.507 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619659+0000", 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3079e-05 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619690+0000", 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1118000000000003e-05 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.508 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619710+0000", 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9351000000000002e-05 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619765+0000", 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5093000000000003e-05 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619869+0000", 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000104304 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.509 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.620648+0000", 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000778741 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624519+0000", 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003870779 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627588+0000", 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003069441 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.510 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627662+0000", 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.3548999999999997e-05 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:569 3.es0 3:74c08199:::smithi16036501-50:head [rollback 20] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.619726+0000", 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8569621959999996, 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0088185109999999994, 2024-09-18T10:32:05.511 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 569 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619726+0000", 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.512 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619726+0000", 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619725+0000", 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619730+0000", 2024-09-18T10:32:05.513 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.4170000000000002e-06 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619736+0000", 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6400000000000002e-06 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619742+0000", 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0800000000000002e-06 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.514 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621334+0000", 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0015926130000000001 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621444+0000", 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00011003899999999999 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622024+0000", 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00058015499999999995 2024-09-18T10:32:05.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627329+0000", 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053043880000000002 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628492+0000", 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001162857 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628545+0000", 2024-09-18T10:32:05.516 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3018e-05 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:570 3.es0 3:74c08199:::smithi16036501-50:head [append 0~0] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.619769+0000", 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8569197870000007, 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0089254989999999999, 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:05.517 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 570 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619769+0000", 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619769+0000", 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.518 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619768+0000", 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619777+0000", 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.772e-06 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619784+0000", 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0149999999999998e-06 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.519 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.619794+0000", 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5910000000000002e-06 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622536+0000", 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027423529999999999 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622658+0000", 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00012208799999999999 2024-09-18T10:32:05.520 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.623133+0000", 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000474704 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.627332+0000", 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041994049999999998 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628631+0000", 2024-09-18T10:32:05.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0012987459999999999 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.628694+0000", 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3287000000000006e-05 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=292, reqid=client.4589.0:565, at_version=71'80, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.621964+0000", 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8547245219999997, 2024-09-18T10:32:05.522 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080461500000000002, 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621964+0000", 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621964+0000", 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.523 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.621963+0000", 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622722+0000", 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00075876600000000002 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622736+0000", 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3993e-05 2024-09-18T10:32:05.524 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622742+0000", 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7070000000000003e-06 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622788+0000", 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5753000000000001e-05 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622795+0000", 2024-09-18T10:32:05.525 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7299999999999999e-06 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.629982+0000", 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0071871410000000002 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.630010+0000", 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8002999999999999e-05 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.526 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 71/33 ECSubWrite(tid=293, reqid=client.4589.0:566, at_version=71'81, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.8539309750000008, 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0072716869999999998, 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.527 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622757+0000", 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622768+0000", 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1386000000000001e-05 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.528 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622777+0000", 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.7509999999999997e-06 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.622782+0000", 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6870000000000002e-06 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624401+0000", 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0016187910000000001 2024-09-18T10:32:05.529 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5028000000000001e-05 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.630015+0000", 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055990279999999998 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.630029+0000", 2024-09-18T10:32:05.530 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4486e-05 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 72/33 ECSubWrite(tid=179, reqid=osd.13.0:179, at_version=72'87, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.7949900599999999, 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012584682, 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.531 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681698+0000", 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.532 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681721+0000", 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3754e-05 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681731+0000", 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.8239999999999995e-06 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681744+0000", 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.223e-05 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.533 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682097+0000", 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00035303999999999999 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682107+0000", 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0386e-05 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694258+0000", 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012150642 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.534 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694283+0000", 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5411000000000001e-05 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 72/33 ECSubWrite(tid=180, reqid=osd.13.0:180, at_version=72'89, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:32:05.535 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.7943960529999998, 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012009316000000001, 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.536 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682292+0000", 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682313+0000", 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1603e-05 2024-09-18T10:32:05.537 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682324+0000", 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1063000000000001e-05 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682331+0000", 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3570000000000003e-06 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682589+0000", 2024-09-18T10:32:05.538 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00025793399999999997 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682598+0000", 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4590000000000004e-06 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694290+0000", 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011691417000000001 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.539 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694302+0000", 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2064e-05 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 72/33 ECSubWrite(tid=313, reqid=osd.4.0:313, at_version=72'85, trim_to=0'0, roll_forward_to=71'83))", 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.7917871470000009, 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010316903000000001, 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.540 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684901+0000", 2024-09-18T10:32:05.541 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684921+0000", 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0237999999999998e-05 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684935+0000", 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3562e-05 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.542 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684943+0000", 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9610000000000005e-06 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684999+0000", 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6378999999999997e-05 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685011+0000", 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1377e-05 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.543 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.695187+0000", 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010176418 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.695218+0000", 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1136999999999997e-05 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 72/33 ECSubWrite(tid=315, reqid=osd.4.0:315, at_version=72'87, trim_to=0'0, roll_forward_to=71'83))", 2024-09-18T10:32:05.544 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.685916+0000", 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.7907724219999999, 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011222055, 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685916+0000", 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685916+0000", 2024-09-18T10:32:05.545 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685915+0000", 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685942+0000", 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6744999999999999e-05 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.546 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685961+0000", 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9006999999999999e-05 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685968+0000", 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5340000000000002e-06 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.688738+0000", 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027699999999999999 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.547 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.688751+0000", 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2659e-05 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697111+0000", 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0083599179999999992 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697138+0000", 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7282000000000001e-05 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.548 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.7s1 72/33 ECSubWrite(tid=316, reqid=client.4589.0:594, at_version=72'88, trim_to=0'0, roll_forward_to=71'83))", 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.686966+0000", 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.7897228720000005, 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010191324999999999, 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686966+0000", 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.549 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686966+0000", 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686965+0000", 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686982+0000", 2024-09-18T10:32:05.550 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7359000000000001e-05 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686996+0000", 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3774999999999999e-05 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.687001+0000", 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.293e-06 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.551 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694337+0000", 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0073363480000000003 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694348+0000", 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.039e-05 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697142+0000", 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0027944340000000002 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.552 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.697157+0000", 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4583000000000001e-05 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 72/33 ECSubWrite(tid=318, reqid=osd.4.0:318, at_version=72'98, trim_to=0'0, roll_forward_to=71'96))", 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.696798+0000", 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 8.7798903920000004, 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056129020000000003, 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.553 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696798+0000", 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696798+0000", 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696797+0000", 2024-09-18T10:32:05.554 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696823+0000", 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6525000000000001e-05 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696836+0000", 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2845e-05 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.555 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696853+0000", 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6663e-05 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696937+0000", 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3788000000000005e-05 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.696950+0000", 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3399e-05 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.556 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.702380+0000", 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054301990000000001 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.702411+0000", 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0576e-05 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.557 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 75/33 ECSubWrite(tid=198, reqid=osd.13.0:198, at_version=75'99, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.708159+0000", 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.7685291679999997, 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0063098870000000001, 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708159+0000", 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.558 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708159+0000", 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708159+0000", 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708181+0000", 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1951999999999999e-05 2024-09-18T10:32:05.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708192+0000", 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0898e-05 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708198+0000", 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.066e-06 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.560 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708277+0000", 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9361000000000001e-05 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708287+0000", 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0028e-05 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714443+0000", 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006155743 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.561 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714469+0000", 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6055e-05 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs5 75/33 ECSubWrite(tid=199, reqid=osd.13.0:199, at_version=75'101, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.709429+0000", 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.7672597530000003, 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0077344170000000004, 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.562 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709429+0000", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709429+0000", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709428+0000", 2024-09-18T10:32:05.563 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709448+0000", 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9868999999999999e-05 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709459+0000", 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1154e-05 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.564 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709465+0000", 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6370000000000004e-06 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709590+0000", 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00012519899999999999 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709599+0000", 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2369999999999998e-06 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.565 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717139+0000", 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075399940000000004 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717163+0000", 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4076000000000001e-05 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.bs4 75/33 ECSubWrite(tid=346, reqid=osd.4.0:346, at_version=75'105, trim_to=0'0, roll_forward_to=73'103))", 2024-09-18T10:32:05.566 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710588+0000", 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 5.7660999400000001, 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070506900000000001, 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710588+0000", 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710588+0000", 2024-09-18T10:32:05.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710588+0000", 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710610+0000", 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1719e-05 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.568 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710621+0000", 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1440000000000001e-05 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710627+0000", 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6729999999999997e-06 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710669+0000", 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2070999999999998e-05 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.569 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710676+0000", 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8220000000000001e-06 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717616+0000", 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0069400620000000003 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717639+0000", 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3102999999999999e-05 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.570 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.571 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.571 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.571 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.571 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:05.572 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:32:05.573 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:05.571+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:05.604 INFO:tasks.rados.rados.0.smithi160.stdout:284: done (0 left) 2024-09-18T10:32:05.604 INFO:tasks.rados.rados.0.smithi160.stdout:285: snap_remove snap 22 2024-09-18T10:32:05.673 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:05.672+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:05.702 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.703 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:05.703 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:32:05.703 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:05.711 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:32:05.774 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:05.773+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:05.850 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:32:05.850 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:32:05.850 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:05.858 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:32:05.874 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:05.874+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:05.957 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:05.957 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:32:05.957 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:32:05.957 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:41 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'23, mlcod=24'19)", 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.959436994999997, 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055352270000000002, 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.958 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996043+0000", 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996042+0000", 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.959 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996105+0000", 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3058999999999994e-05 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996120+0000", 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4555999999999999e-05 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996126+0000", 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1550000000000004e-06 2024-09-18T10:32:05.960 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996159+0000", 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3147e-05 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:02.996172+0000", 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2802e-05 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.961 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001546+0000", 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0053743339999999997 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001578+0000", 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1952000000000002e-05 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.962 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:50 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'32, mlcod=24'21)", 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.954467469999997, 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058482279999999996, 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.963 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001013+0000", 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001012+0000", 2024-09-18T10:32:05.964 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001087+0000", 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5179999999999995e-05 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001097+0000", 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0253e-05 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.966 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001105+0000", 2024-09-18T10:32:05.966 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9410000000000007e-06 2024-09-18T10:32:05.966 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001141+0000", 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5515999999999997e-05 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.001162+0000", 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0917999999999999e-05 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.967 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006825+0000", 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056635110000000004 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.006861+0000", 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5673000000000002e-05 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.968 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:71 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'49, mlcod=25'45)", 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.821673683, 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060683170000000002, 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.969 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133806+0000", 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133811+0000", 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4179999999999996e-06 2024-09-18T10:32:05.970 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133820+0000", 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9050000000000003e-06 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133824+0000", 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3969999999999998e-06 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.971 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133864+0000", 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0028999999999999e-05 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.133883+0000", 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9049e-05 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.972 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139840+0000", 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059569510000000003 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139875+0000", 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5117000000000003e-05 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.973 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:72 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'50, mlcod=25'45)", 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.821265390999997, 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056771290000000004, 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.974 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134215+0000", 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134214+0000", 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134252+0000", 2024-09-18T10:32:05.975 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7412e-05 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134261+0000", 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134271+0000", 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0716999999999999e-05 2024-09-18T10:32:05.976 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134305+0000", 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4031e-05 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.977 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.134325+0000", 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9318e-05 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139878+0000", 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055528139999999997 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139892+0000", 2024-09-18T10:32:05.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4192999999999999e-05 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:75 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'53, mlcod=25'45)", 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.819997125, 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070322270000000003, 2024-09-18T10:32:05.979 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.981 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135483+0000", 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135546+0000", 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3405999999999996e-05 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.982 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135554+0000", 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.5780000000000001e-06 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.135557+0000", 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.912e-06 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136700+0000", 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00114241 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.983 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136711+0000", 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1445e-05 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142483+0000", 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057715509999999998 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.142515+0000", 2024-09-18T10:32:05.984 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2313e-05 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:76 1.0 e25/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 25'54, mlcod=25'45)", 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.819400274000003, 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091963210000000004, 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.985 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136080+0000", 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136079+0000", 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.986 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136090+0000", 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0294e-05 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136096+0000", 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5549999999999999e-06 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.136099+0000", 2024-09-18T10:32:05.987 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1650000000000002e-06 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139649+0000", 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0035492869999999999 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.139663+0000", 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4232e-05 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.988 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145234+0000", 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055716799999999999 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.145276+0000", 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1618e-05 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.989 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_repop(client.4206.0:79 1.0 e25/23 1:30306672:devicehealth::main.db.0000000000000000:head v 25'57, mlcod=25'53)", 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 62.808375564999999, 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057630829999999996, 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.990 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147104+0000", 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147180+0000", 2024-09-18T10:32:05.991 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.6073000000000002e-05 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147189+0000", 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4460000000000001e-06 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147192+0000", 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6349999999999999e-06 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.992 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147225+0000", 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3318000000000002e-05 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.147240+0000", 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4397e-05 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152821+0000", 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005580616 2024-09-18T10:32:05.993 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:03.152868+0000", 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7043999999999999e-05 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 39/33 ECSubWrite(tid=29, reqid=client.4589.0:207, at_version=39'19, trim_to=0'0, roll_forward_to=38'17))", 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.675825181999997, 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055838909999999997, 2024-09-18T10:32:05.994 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.995 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.279655+0000", 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280401+0000", 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074599499999999995 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.996 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280415+0000", 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4711e-05 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280422+0000", 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6209999999999998e-06 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280486+0000", 2024-09-18T10:32:05.997 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3670999999999994e-05 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.280494+0000", 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8599999999999993e-06 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285203+0000", 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0047090980000000001 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:24.285239+0000", 2024-09-18T10:32:05.998 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6112999999999998e-05 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s4 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 36.632848246999998, 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056939590000000002, 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:05.999 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322632+0000", 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322631+0000", 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.000 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322653+0000", 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1883e-05 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322665+0000", 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2434e-05 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322672+0000", 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.1799999999999999e-06 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.001 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322722+0000", 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9963999999999998e-05 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.322730+0000", 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0859999999999996e-06 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328297+0000", 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.005567326 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.002 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328326+0000", 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8915e-05 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s1 49/33 ECSubWrite(tid=30, reqid=osd.8.0:30, at_version=49'22, trim_to=0'0, roll_forward_to=47'18))", 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 32.358114700000002, 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060374210000000003, 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.003 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597365+0000", 2024-09-18T10:32:06.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597379+0000", 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3862999999999999e-05 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597387+0000", 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9149999999999996e-06 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.005 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597391+0000", 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8310000000000003e-06 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599813+0000", 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024224110000000002 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.599822+0000", 2024-09-18T10:32:06.006 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.8610000000000004e-06 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603383+0000", 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003560798 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603403+0000", 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9915000000000002e-05 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.007 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 49/33 ECSubWrite(tid=92, reqid=osd.13.0:92, at_version=49'33, trim_to=0'0, roll_forward_to=47'31))", 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 32.357979551, 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0061865829999999998, 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.008 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597500+0000", 2024-09-18T10:32:06.009 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597519+0000", 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8604e-05 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597527+0000", 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.3760000000000008e-06 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.010 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597532+0000", 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.9779999999999996e-06 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597587+0000", 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4666000000000001e-05 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.597597+0000", 2024-09-18T10:32:06.011 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0448999999999999e-05 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603670+0000", 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060726390000000003 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.603687+0000", 2024-09-18T10:32:06.012 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7345000000000001e-05 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 72/33 ECSubWrite(tid=179, reqid=osd.13.0:179, at_version=72'87, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.683359+0000", 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.2721207490000008, 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0081603950000000008, 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.013 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683359+0000", 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683359+0000", 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.014 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683359+0000", 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683389+0000", 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9414e-05 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.015 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683401+0000", 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2662e-05 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683409+0000", 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.0560000000000005e-06 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683471+0000", 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2179000000000002e-05 2024-09-18T10:32:06.016 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683483+0000", 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2038000000000001e-05 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691488+0000", 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080048169999999991 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691520+0000", 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1408999999999997e-05 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 72/33 ECSubWrite(tid=180, reqid=osd.13.0:180, at_version=72'89, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.683508+0000", 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.2719720349999992, 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010818487, 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.018 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683508+0000", 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683508+0000", 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.019 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683507+0000", 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683536+0000", 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.885e-05 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683548+0000", 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1687e-05 2024-09-18T10:32:06.020 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.683561+0000", 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2678e-05 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685667+0000", 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0021059659999999999 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.021 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685675+0000", 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2069999999999995e-06 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694301+0000", 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086264659999999993 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694326+0000", 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5213999999999999e-05 2024-09-18T10:32:06.022 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 72/33 ECSubWrite(tid=100, reqid=osd.0.0:100, at_version=72'80, trim_to=0'0, roll_forward_to=71'78))", 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.685538+0000", 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 9.2699420949999993, 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0087451330000000004, 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.023 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685538+0000", 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685538+0000", 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.024 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685537+0000", 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685561+0000", 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3450000000000001e-05 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685571+0000", 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9709999999999999e-06 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.025 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685579+0000", 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4230000000000005e-06 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685633+0000", 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3680000000000001e-05 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.026 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.685643+0000", 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9650000000000003e-06 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694250+0000", 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086070609999999992 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694283+0000", 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3290999999999997e-05 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.027 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 75/33 ECSubWrite(tid=116, reqid=client.4589.0:659, at_version=75'93, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.706724+0000", 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.2487555690000001, 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079646079999999998, 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.028 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706724+0000", 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706724+0000", 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706724+0000", 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.029 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706810+0000", 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6541999999999999e-05 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706824+0000", 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3817e-05 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706831+0000", 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5919999999999997e-06 2024-09-18T10:32:06.030 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706926+0000", 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5215000000000002e-05 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.706936+0000", 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9389999999999992e-06 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714654+0000", 2024-09-18T10:32:06.031 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0077176700000000003 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714689+0000", 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5531999999999998e-05 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 75/33 ECSubWrite(tid=117, reqid=client.4589.0:660, at_version=75'94, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.707586+0000", 2024-09-18T10:32:06.032 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.2478936579999997, 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0071509920000000001, 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707586+0000", 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707586+0000", 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.033 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707586+0000", 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707608+0000", 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2430999999999999e-05 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707618+0000", 2024-09-18T10:32:06.034 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0074999999999999e-05 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707624+0000", 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0499999999999997e-06 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707664+0000", 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9773e-05 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707672+0000", 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.0800000000000006e-06 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714722+0000", 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070497449999999996 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714737+0000", 2024-09-18T10:32:06.036 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5376999999999999e-05 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s5 75/33 ECSubWrite(tid=99, reqid=osd.3.0:99, at_version=75'82, trim_to=0'0, roll_forward_to=73'80))", 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.707869+0000", 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.2476111339999996, 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006690896, 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.037 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707869+0000", 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707869+0000", 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.038 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707869+0000", 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707891+0000", 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1891000000000001e-05 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707900+0000", 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3300000000000005e-06 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707907+0000", 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7349999999999999e-06 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707962+0000", 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5352999999999997e-05 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707972+0000", 2024-09-18T10:32:06.040 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9620000000000005e-06 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714534+0000", 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0065621200000000003 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714560+0000", 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5701999999999999e-05 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.041 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 75/33 ECSubWrite(tid=198, reqid=osd.13.0:198, at_version=75'99, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.708180+0000", 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.2472995859999996, 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0064122110000000001, 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708180+0000", 2024-09-18T10:32:06.042 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708180+0000", 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708180+0000", 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.043 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708196+0000", 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5855999999999999e-05 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708204+0000", 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.7020000000000001e-06 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708209+0000", 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2399999999999998e-06 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.044 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708250+0000", 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1035999999999998e-05 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708258+0000", 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.1489999999999994e-06 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.045 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714573+0000", 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006314961 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714593+0000", 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9624e-05 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.6s6 75/33 ECSubWrite(tid=118, reqid=client.4589.0:661, at_version=75'95, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:06.046 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.708558+0000", 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.2469215379999996, 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0061933459999999997, 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708558+0000", 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708558+0000", 2024-09-18T10:32:06.047 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708558+0000", 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708573+0000", 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5293000000000001e-05 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708582+0000", 2024-09-18T10:32:06.048 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1940000000000004e-06 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708594+0000", 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1790999999999999e-05 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708636+0000", 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1594999999999997e-05 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.049 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708648+0000", 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2437e-05 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714740+0000", 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0060914690000000004 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.714752+0000", 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2221e-05 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.050 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs2 75/33 ECSubWrite(tid=199, reqid=osd.13.0:199, at_version=75'101, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.709325+0000", 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 6.2461555300000002, 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080938179999999992, 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709325+0000", 2024-09-18T10:32:06.051 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709325+0000", 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709324+0000", 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.052 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709348+0000", 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4542999999999999e-05 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709359+0000", 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0448999999999999e-05 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709364+0000", 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5999999999999997e-06 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.053 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709403+0000", 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8263000000000003e-05 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709411+0000", 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4079999999999998e-06 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717393+0000", 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079815939999999998 2024-09-18T10:32:06.054 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717418+0000", 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5595000000000001e-05 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:06.055 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:06.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:32:06.057 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:06.055+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:06.158 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:06.157+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:06.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:32:06.258 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:06.257+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:06.284 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:06.284 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:06.293 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:32:06.300 INFO:teuthology.orchestra.run.smithi071.stdout: marking collection for removal 2024-09-18T10:32:06.300 INFO:teuthology.orchestra.run.smithi071.stdout:setting '_remove' omap key 2024-09-18T10:32:06.300 INFO:teuthology.orchestra.run.smithi071.stdout:finish_remove_pgs 3.6s5_head removing 3.6s5 2024-09-18T10:32:06.307 INFO:teuthology.orchestra.run.smithi071.stdout:Remove successful 2024-09-18T10:32:06.360 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:06.359+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:06.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:207 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~671744] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.159918517000001, 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011106883, 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 207 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274787+0000", 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999962 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275694+0000", 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090683300000000001 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275721+0000", 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6876000000000002e-05 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275732+0000", 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1522000000000001e-05 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275808+0000", 2024-09-18T10:32:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5581999999999996e-05 2024-09-18T10:32:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275818+0000", 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0659000000000001e-05 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278499+0000", 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026808629999999999 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278574+0000", 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4624999999999998e-05 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.279516+0000", 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094181099999999997 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284510+0000", 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049937749999999998 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285779+0000", 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001269648 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285898+0000", 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118659 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:210 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 42.157202963000003, 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011901998, 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 210 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277506+0000", 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277509+0000", 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6199999999999999e-06 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277515+0000", 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.613e-06 2024-09-18T10:32:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277519+0000", 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.162e-06 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277555+0000", 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6918999999999997e-05 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277558+0000", 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7980000000000001e-06 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284798+0000", 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072393049999999997 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284870+0000", 2024-09-18T10:32:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2249999999999994e-05 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287687+0000", 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028174189999999998 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287819+0000", 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013145400000000001 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289409+0000", 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015898380000000001 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:297 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~458752] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.113154487999999, 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0124782, 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 297 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321554+0000", 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323224+0000", 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00166989 2024-09-18T10:32:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323245+0000", 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1603999999999998e-05 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323251+0000", 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9070000000000004e-06 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323311+0000", 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9367000000000003e-05 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323391+0000", 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0776e-05 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324288+0000", 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089698299999999996 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330155+0000", 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058662219999999999 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333879+0000", 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003724195 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334033+0000", 2024-09-18T10:32:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015450800000000001 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:298 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.110465888999997, 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012910115999999999, 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 298 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324242+0000", 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324759+0000", 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051612499999999998 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324774+0000", 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5777000000000002e-05 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324782+0000", 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.593e-06 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325756+0000", 2024-09-18T10:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097372699999999997 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325903+0000", 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014782799999999999 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326741+0000", 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083760900000000001 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330156+0000", 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034153109999999999 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337078+0000", 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069219210000000002 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337154+0000", 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5430000000000001e-05 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:299 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~294912] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.108463135000001, 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01141987, 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 299 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326245+0000", 2024-09-18T10:32:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326658+0000", 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041379600000000002 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6379e-05 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326688+0000", 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3531e-05 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327587+0000", 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089865099999999999 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327696+0000", 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010859 2024-09-18T10:32:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328440+0000", 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074455699999999997 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330157+0000", 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017169279999999999 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337590+0000", 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007433271 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337666+0000", 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5909999999999997e-05 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:300 3.6s0 3:6fd2113e:::smithi16036501-26:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.108009844999998, 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011253185000000001, 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 300 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326699+0000", 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326705+0000", 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4219999999999997e-06 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326713+0000", 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2179999999999999e-06 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326721+0000", 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8299999999999996e-06 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329116+0000", 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023944589999999998 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329207+0000", 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1532000000000004e-05 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329752+0000", 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00054480399999999997 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331260+0000", 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001508258 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337875+0000", 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066149590000000001 2024-09-18T10:32:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337953+0000", 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7750000000000006e-05 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:301 3.6s0 3:6fd2113e:::smithi16036501-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.107982620999998, 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015768265, 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 301 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326726+0000", 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326729+0000", 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3189999999999999e-06 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326739+0000", 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3910000000000004e-06 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326744+0000", 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7119999999999999e-06 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330251+0000", 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003507175 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330345+0000", 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3974999999999994e-05 2024-09-18T10:32:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338416+0000", 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080714459999999995 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338553+0000", 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013656000000000001 2024-09-18T10:32:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342495+0000", 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003942409 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:308 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.107944353000001, 2024-09-18T10:32:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013544333, 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 308 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326768+0000", 2024-09-18T10:32:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1820000000000002e-06 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326776+0000", 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5229999999999998e-06 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326781+0000", 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0950000000000003e-06 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330731+0000", 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039508199999999999 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330823+0000", 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1259000000000002e-05 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340309+0000", 2024-09-18T10:32:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0094867969999999999 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:309 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.107923933000002, 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015227746, 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 309 2024-09-18T10:32:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326785+0000", 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326789+0000", 2024-09-18T10:32:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7239999999999998e-06 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326797+0000", 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4100000000000008e-06 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326802+0000", 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.549e-06 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332723+0000", 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059212609999999997 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332837+0000", 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114342 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342013+0000", 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091760220000000007 2024-09-18T10:32:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.7s3 56/33 ECSubWrite(tid=214, reqid=osd.4.0:214, at_version=56'60, trim_to=0'0, roll_forward_to=55'56))", 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.791698829000001, 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012700209, 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.642728+0000", 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9997168 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643033+0000", 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030590899999999999 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643042+0000", 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8400000000000001e-06 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643047+0000", 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.899e-06 2024-09-18T10:32:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644506+0000", 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001458984 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644514+0000", 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8469999999999996e-06 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655681+0000", 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011167089 2024-09-18T10:32:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655711+0000", 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9740999999999999e-05 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.fs6 56/33 ECSubWrite(tid=122, reqid=osd.13.0:122, at_version=56'54, trim_to=0'0, roll_forward_to=55'50))", 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 25.790802909, 2024-09-18T10:32:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011833527999999999, 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643906+0000", 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643925+0000", 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9491999999999999e-05 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643936+0000", 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0251999999999999e-05 2024-09-18T10:32:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643941+0000", 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5849999999999999e-06 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644566+0000", 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000624999 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644574+0000", 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1259999999999998e-06 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655717+0000", 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011142284000000001 2024-09-18T10:32:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655740+0000", 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3431e-05 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:493 3.6s0 3:61935b36:::smithi16036501-8:head [rollback 6] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.835709184999999, 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011749647, 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 493 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599003+0000", 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1530000000000001e-06 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599007+0000", 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.357e-06 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599010+0000", 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9050000000000001e-06 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599162+0000", 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151698 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599172+0000", 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0538e-05 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.602723+0000", 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003550901 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.602821+0000", 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7480999999999997e-05 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603339+0000", 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051815499999999996 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607511+0000", 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041719299999999999 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610676+0000", 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031649569999999999 2024-09-18T10:32:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610750+0000", 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4058000000000001e-05 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:494 3.6s0 3:61935b36:::smithi16036501-8:head [append 0~0] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.835663193999999, 2024-09-18T10:32:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014595138000000001, 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 494 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599050+0000", 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3950000000000003e-06 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599058+0000", 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.559e-06 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599061+0000", 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4120000000000001e-06 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599218+0000", 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015663600000000001 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599222+0000", 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7770000000000002e-06 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603678+0000", 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044553229999999997 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603784+0000", 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106259 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.604317+0000", 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053261499999999995 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607512+0000", 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003195603 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613563+0000", 2024-09-18T10:32:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060504870000000002 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613641+0000", 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8678999999999997e-05 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:497 3.6s0 3:637715d3:::smithi16036501-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.835612220000002, 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011056935, 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 497 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599101+0000", 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.895e-06 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599104+0000", 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4960000000000001e-06 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599110+0000", 2024-09-18T10:32:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1800000000000004e-06 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599276+0000", 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016677200000000001 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599280+0000", 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3720000000000001e-06 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606994+0000", 2024-09-18T10:32:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077141780000000004 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607091+0000", 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6935999999999995e-05 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610154+0000", 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030633919999999999 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:498 3.6s0 3:637715d3:::smithi16036501-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.835596051, 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015978455999999999, 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 498 2024-09-18T10:32:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599116+0000", 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599122+0000", 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.823e-06 2024-09-18T10:32:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599126+0000", 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7469999999999999e-06 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599303+0000", 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000176999 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599310+0000", 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5939999999999996e-06 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610213+0000", 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010902935000000001 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610306+0000", 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2299999999999994e-05 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615092+0000", 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047863489999999996 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:499 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~491520] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.828804627, 2024-09-18T10:32:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014076979999999999, 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605903+0000", 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606922+0000", 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010196350000000001 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606937+0000", 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.467e-05 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606944+0000", 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6379999999999998e-06 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610822+0000", 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038785320000000001 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610929+0000", 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106656 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.612009+0000", 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001079614 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.614222+0000", 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022135829999999999 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.619906+0000", 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056843110000000001 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.619982+0000", 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5432000000000006e-05 2024-09-18T10:32:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:500 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~589824] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.825044570999999, 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010745407, 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 500 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609664+0000", 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610170+0000", 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050623900000000002 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610184+0000", 2024-09-18T10:32:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3935e-05 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610191+0000", 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5370000000000003e-06 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615172+0000", 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049813380000000001 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615289+0000", 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117366 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.616406+0000", 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001116391 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620060+0000", 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036545869999999999 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620328+0000", 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026800199999999999 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620410+0000", 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2047999999999998e-05 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:502 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~16384] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.821293952000001, 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010603589, 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 502 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613414+0000", 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613432+0000", 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8111e-05 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613440+0000", 2024-09-18T10:32:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.858e-06 2024-09-18T10:32:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613445+0000", 2024-09-18T10:32:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3669999999999999e-06 2024-09-18T10:32:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620505+0000", 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0070606810000000001 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620608+0000", 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102965 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621026+0000", 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000417427 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622355+0000", 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001329553 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.623941+0000", 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015858859999999999 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624019+0000", 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7918999999999997e-05 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:503 3.6s0 3:623b1fe4:::smithi16036501-43:head [setxattr _header (57) in=7b] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.821259489999999, 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01079954, 2024-09-18T10:32:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 503 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613449+0000", 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613454+0000", 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9919999999999998e-06 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613459+0000", 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.25e-06 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613461+0000", 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.667e-06 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621427+0000", 2024-09-18T10:32:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079660300000000007 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621541+0000", 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011382099999999999 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622066+0000", 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052472200000000004 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622656+0000", 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059010400000000004 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624184+0000", 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527736 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624250+0000", 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.58e-05 2024-09-18T10:32:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:504 3.6s0 3:623b1fe4:::smithi16036501-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 20.821245439999998, 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011964740999999999, 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 504 2024-09-18T10:32:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613465+0000", 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4899999999999999e-06 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613469+0000", 2024-09-18T10:32:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6619999999999998e-06 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613472+0000", 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6019999999999998e-06 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622527+0000", 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090558270000000007 2024-09-18T10:32:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622626+0000", 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8653999999999994e-05 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624532+0000", 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001906072 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624625+0000", 2024-09-18T10:32:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2559000000000006e-05 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.625429+0000", 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080416099999999996 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:06.554 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:06.556 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:06.554+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:06.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:32:06.557 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:06.557 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:06.570 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:06.570 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:06.586 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:06.587 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:06.604 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:06.604 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:06.607 INFO:tasks.rados.rados.0.smithi160.stdout:285: done (0 left) 2024-09-18T10:32:06.607 INFO:tasks.rados.rados.0.smithi160.stdout:286: copy_from oid 28 from oid 44 current snap is 23 2024-09-18T10:32:06.607 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 48 current snap is 23 2024-09-18T10:32:06.607 INFO:tasks.rados.rados.0.smithi160.stdout:287: seq_num 128 ranges {802816=606208,1409024=507904,1916928=573440,2490368=475136} 2024-09-18T10:32:06.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T10:32:06.616 INFO:tasks.rados.rados.0.smithi160.stdout:287: writing smithi16036501-48 from 802816 to 1409024 tid 1 2024-09-18T10:32:06.619 INFO:tasks.rados.rados.0.smithi160.stdout:287: writing smithi16036501-48 from 1409024 to 1916928 tid 2 2024-09-18T10:32:06.622 INFO:tasks.rados.rados.0.smithi160.stdout:287: writing smithi16036501-48 from 1916928 to 2490368 tid 3 2024-09-18T10:32:06.626 INFO:tasks.rados.rados.0.smithi160.stdout:287: writing smithi16036501-48 from 2490368 to 2965504 tid 4 2024-09-18T10:32:06.626 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 37 current snap is 23 2024-09-18T10:32:06.627 INFO:tasks.rados.rados.0.smithi160.stdout:288: seq_num 129 ranges {4554752=622592,5177344=655360,5832704=688128,6520832=212992} 2024-09-18T10:32:06.629 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:06.630 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:06.644 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:06.654 INFO:tasks.rados.rados.0.smithi160.stdout:288: writing smithi16036501-37 from 4554752 to 5177344 tid 1 2024-09-18T10:32:06.656 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:06.655+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:06.657 INFO:tasks.rados.rados.0.smithi160.stdout:288: writing smithi16036501-37 from 5177344 to 5832704 tid 2 2024-09-18T10:32:06.661 INFO:tasks.rados.rados.0.smithi160.stdout:288: writing smithi16036501-37 from 5832704 to 6520832 tid 3 2024-09-18T10:32:06.663 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:06.663 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:288: writing smithi16036501-37 from 6520832 to 6733824 tid 4 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:289: setattr oid 41 current snap is 23 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:286: finishing copy_from racing read to smithi16036501-28 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:286: finishing copy_from to smithi16036501-28 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 28 v 15 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:287: finishing write tid 1 to smithi16036501-48 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:287: finishing write tid 2 to smithi16036501-48 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:287: finishing write tid 3 to smithi16036501-48 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:287: finishing write tid 4 to smithi16036501-48 2024-09-18T10:32:06.664 INFO:tasks.rados.rados.0.smithi160.stdout:287: finishing write tid 5 to smithi16036501-48 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:287: finishing write tid 6 to smithi16036501-48 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 48 v 16 (ObjNum 128 snap 23 seq_num 128) dirty exists 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:287: left oid 48 (ObjNum 128 snap 23 seq_num 128) 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:288: finishing write tid 1 to smithi16036501-37 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:286: done (3 left) 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:287: done (2 left) 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 17 current snap is 23 2024-09-18T10:32:06.665 INFO:tasks.rados.rados.0.smithi160.stdout:290: seq_num 130 ranges {1490944=638976,2129920=671744,2801664=802816,3604480=81920} 2024-09-18T10:32:06.675 INFO:tasks.rados.rados.0.smithi160.stdout:290: writing smithi16036501-17 from 1490944 to 2129920 tid 1 2024-09-18T10:32:06.679 INFO:tasks.rados.rados.0.smithi160.stdout:290: writing smithi16036501-17 from 2129920 to 2801664 tid 2 2024-09-18T10:32:06.684 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:06.684 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:06.684 INFO:tasks.rados.rados.0.smithi160.stdout:290: writing smithi16036501-17 from 2801664 to 3604480 tid 3 2024-09-18T10:32:06.685 INFO:tasks.rados.rados.0.smithi160.stdout:290: writing smithi16036501-17 from 3604480 to 3686400 tid 4 2024-09-18T10:32:06.685 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 28 current snap is 23 2024-09-18T10:32:06.685 INFO:tasks.rados.rados.0.smithi160.stdout:291: seq_num 131 ranges {1261568=655360,1916928=425984,2342912=638976,2981888=491520} 2024-09-18T10:32:06.687 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:06.687 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:06.696 INFO:tasks.rados.rados.0.smithi160.stdout:291: writing smithi16036501-28 from 1261568 to 1916928 tid 1 2024-09-18T10:32:06.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:32:06.699 INFO:tasks.rados.rados.0.smithi160.stdout:291: writing smithi16036501-28 from 1916928 to 2342912 tid 2 2024-09-18T10:32:06.701 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:06.701 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:06.701 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:06.703 INFO:tasks.rados.rados.0.smithi160.stdout:291: writing smithi16036501-28 from 2342912 to 2981888 tid 3 2024-09-18T10:32:06.706 INFO:tasks.rados.rados.0.smithi160.stdout:291: writing smithi16036501-28 from 2981888 to 3473408 tid 4 2024-09-18T10:32:06.706 INFO:tasks.rados.rados.0.smithi160.stdout:292: delete oid 34 current snap is 23 2024-09-18T10:32:06.706 INFO:tasks.rados.rados.0.smithi160.stdout:288: finishing write tid 2 to smithi16036501-37 2024-09-18T10:32:06.706 INFO:tasks.rados.rados.0.smithi160.stdout:288: finishing write tid 3 to smithi16036501-37 2024-09-18T10:32:06.706 INFO:tasks.rados.rados.0.smithi160.stdout:288: finishing write tid 4 to smithi16036501-37 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:288: finishing write tid 5 to smithi16036501-37 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 41 v 103 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:288: finishing write tid 6 to smithi16036501-37 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 105 (ObjNum 129 snap 23 seq_num 129) dirty exists 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:288: left oid 37 (ObjNum 129 snap 23 seq_num 129) 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: finishing write tid 1 to smithi16036501-17 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: finishing write tid 2 to smithi16036501-17 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: finishing write tid 3 to smithi16036501-17 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: finishing write tid 4 to smithi16036501-17 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: finishing write tid 5 to smithi16036501-17 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: finishing write tid 6 to smithi16036501-17 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 96 (ObjNum 130 snap 23 seq_num 130) dirty exists 2024-09-18T10:32:06.707 INFO:tasks.rados.rados.0.smithi160.stdout:290: left oid 17 (ObjNum 130 snap 23 seq_num 130) 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:291: finishing write tid 1 to smithi16036501-28 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:291: finishing write tid 2 to smithi16036501-28 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:288: done (4 left) 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:289: done (3 left) 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:290: done (2 left) 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:292: done (1 left) 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:293: delete oid 35 current snap is 23 2024-09-18T10:32:06.708 INFO:tasks.rados.rados.0.smithi160.stdout:291: finishing write tid 3 to smithi16036501-28 2024-09-18T10:32:06.709 INFO:tasks.rados.rados.0.smithi160.stdout:291: finishing write tid 4 to smithi16036501-28 2024-09-18T10:32:06.709 INFO:tasks.rados.rados.0.smithi160.stdout:291: finishing write tid 5 to smithi16036501-28 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:293: done (1 left) 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:294: read oid 48 snap -1 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:294: expect (ObjNum 128 snap 23 seq_num 128) 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:295: rollback oid 29 current snap is 23 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:295: done (2 left) 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 16 current snap is 23 2024-09-18T10:32:06.711 INFO:tasks.rados.rados.0.smithi160.stdout:296: seq_num 134 ranges {2473984=704512,3178496=475136,3653632=573440,4227072=507904} 2024-09-18T10:32:06.728 INFO:tasks.rados.rados.0.smithi160.stdout:296: writing smithi16036501-16 from 2473984 to 3178496 tid 1 2024-09-18T10:32:06.731 INFO:tasks.rados.rados.0.smithi160.stdout:296: writing smithi16036501-16 from 3178496 to 3653632 tid 2 2024-09-18T10:32:06.731 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:06.732 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:06.734 INFO:tasks.rados.rados.0.smithi160.stdout:296: writing smithi16036501-16 from 3653632 to 4227072 tid 3 2024-09-18T10:32:06.737 INFO:tasks.rados.rados.0.smithi160.stdout:296: writing smithi16036501-16 from 4227072 to 4734976 tid 4 2024-09-18T10:32:06.738 INFO:tasks.rados.rados.0.smithi160.stdout:297: snap_create 2024-09-18T10:32:06.738 INFO:tasks.rados.rados.0.smithi160.stdout:291: finishing write tid 6 to smithi16036501-28 2024-09-18T10:32:06.738 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 28 v 101 (ObjNum 131 snap 23 seq_num 131) dirty exists 2024-09-18T10:32:06.738 INFO:tasks.rados.rados.0.smithi160.stdout:291: left oid 28 (ObjNum 131 snap 23 seq_num 131) 2024-09-18T10:32:06.738 INFO:tasks.rados.rados.0.smithi160.stdout:296: finishing write tid 1 to smithi16036501-16 2024-09-18T10:32:06.738 INFO:tasks.rados.rados.0.smithi160.stdout:296: finishing write tid 2 to smithi16036501-16 2024-09-18T10:32:06.740 INFO:tasks.rados.rados.0.smithi160.stdout:296: finishing write tid 3 to smithi16036501-16 2024-09-18T10:32:06.743 INFO:tasks.rados.rados.0.smithi160.stdout:296: finishing write tid 4 to smithi16036501-16 2024-09-18T10:32:06.743 INFO:tasks.rados.rados.0.smithi160.stdout:296: finishing write tid 5 to smithi16036501-16 2024-09-18T10:32:06.746 INFO:tasks.rados.rados.0.smithi160.stdout:296: finishing write tid 6 to smithi16036501-16 2024-09-18T10:32:06.746 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 110 (ObjNum 134 snap 23 seq_num 134) dirty exists 2024-09-18T10:32:06.746 INFO:tasks.rados.rados.0.smithi160.stdout:296: left oid 16 (ObjNum 134 snap 23 seq_num 134) 2024-09-18T10:32:06.747 INFO:tasks.rados.rados.0.smithi160.stdout:294: expect (ObjNum 128 snap 23 seq_num 128) 2024-09-18T10:32:06.753 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:06.754 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:06.757 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:06.756+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:06.769 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:06.769 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:06.785 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:06.785 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:06.801 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:06.801 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:06.812 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:06.812 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:06.816 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:06.816 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:06.820 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:06.820 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:06.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.6s5.9 2024-09-18T10:32:06.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:32:06.858 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:06.857+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:06.959 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:06.958+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:06.964 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:06.964 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:06.973 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:32:07.060 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:07.059+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:07.075 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.075 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:32:07.161 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:07.160+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:07.185 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.185 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:32:07.262 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:07.261+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:07.296 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.296 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:32:07.364 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:07.363+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:07.406 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.406 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.415 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:32:07.464 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:07.463+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:07.516 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.516 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:32:07.568 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:07.567+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:07.594 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-18T10:32:07.595 INFO:tasks.rados.rados.0.smithi160.stdout:291: done (3 left) 2024-09-18T10:32:07.595 INFO:tasks.rados.rados.0.smithi160.stdout:294: done (2 left) 2024-09-18T10:32:07.595 INFO:tasks.rados.rados.0.smithi160.stdout:296: done (1 left) 2024-09-18T10:32:07.595 INFO:tasks.rados.rados.0.smithi160.stdout:297: done (0 left) 2024-09-18T10:32:07.595 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 16 current snap is 24 2024-09-18T10:32:07.595 INFO:tasks.rados.rados.0.smithi160.stdout:298: seq_num 135 ranges {4734976=720896,5455872=622592,6078464=688128,6766592=245760} 2024-09-18T10:32:07.623 INFO:tasks.rados.rados.0.smithi160.stdout:298: writing smithi16036501-16 from 4734976 to 5455872 tid 1 2024-09-18T10:32:07.626 INFO:tasks.rados.rados.0.smithi160.stdout:298: writing smithi16036501-16 from 5455872 to 6078464 tid 2 2024-09-18T10:32:07.630 INFO:tasks.rados.rados.0.smithi160.stdout:298: writing smithi16036501-16 from 6078464 to 6766592 tid 3 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:298: writing smithi16036501-16 from 6766592 to 7012352 tid 4 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:299: copy_from oid 40 from oid 14 current snap is 24 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:300: read oid 12 snap -1 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:300: expect (ObjNum 125 snap 20 seq_num 125) 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:301: rollback oid 34 current snap is 24 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 34 to 23 2024-09-18T10:32:07.632 INFO:tasks.rados.rados.0.smithi160.stdout:302: read oid 37 snap -1 2024-09-18T10:32:07.633 INFO:tasks.rados.rados.0.smithi160.stdout:302: expect (ObjNum 129 snap 23 seq_num 129) 2024-09-18T10:32:07.633 INFO:tasks.rados.rados.0.smithi160.stdout:303: snap_create 2024-09-18T10:32:07.633 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.633 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.636 INFO:tasks.rados.rados.0.smithi160.stdout:299: finishing copy_from to smithi16036501-40 2024-09-18T10:32:07.636 INFO:tasks.rados.rados.0.smithi160.stdout:299: got expected ENOENT (src dne) 2024-09-18T10:32:07.636 INFO:tasks.rados.rados.0.smithi160.stdout:299: finishing copy_from racing read to smithi16036501-40 2024-09-18T10:32:07.636 INFO:tasks.rados.rados.0.smithi160.stdout:298: finishing write tid 1 to smithi16036501-16 2024-09-18T10:32:07.641 INFO:tasks.rados.rados.0.smithi160.stdout:298: finishing write tid 2 to smithi16036501-16 2024-09-18T10:32:07.641 INFO:tasks.rados.rados.0.smithi160.stdout:301: finishing rollback tid 1 to smithi16036501-34 2024-09-18T10:32:07.642 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 34 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-18T10:32:07.642 INFO:tasks.rados.rados.0.smithi160.stdout:298: finishing write tid 3 to smithi16036501-16 2024-09-18T10:32:07.642 INFO:tasks.rados.rados.0.smithi160.stdout:298: finishing write tid 4 to smithi16036501-16 2024-09-18T10:32:07.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:32:07.646 INFO:tasks.rados.rados.0.smithi160.stdout:298: finishing write tid 5 to smithi16036501-16 2024-09-18T10:32:07.651 INFO:tasks.rados.rados.0.smithi160.stdout:300: expect (ObjNum 125 snap 20 seq_num 125) 2024-09-18T10:32:07.688 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:07.687+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:07.710 INFO:tasks.rados.rados.0.smithi160.stdout:302: expect (ObjNum 129 snap 23 seq_num 129) 2024-09-18T10:32:07.746 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.746 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:32:07.767 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:07.766+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:07.868 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:07.867+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:07.891 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:07.891 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:07.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:32:07.969 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:07.968+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:07.977 INFO:teuthology.orchestra.run.smithi071.stdout:get_pg_num_history pg_num_history pg_num_history(e73 pg_nums {1={23=1},2={26=8},3={33=16}} deleted_pools ) 2024-09-18T10:32:07.977 INFO:teuthology.orchestra.run.smithi071.stdout:Importing pgid 3.6s5 2024-09-18T10:32:07.977 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:6108c463:::smithi16036501-6:head# 2024-09-18T10:32:07.977 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 4=[]:{} 2024-09-18T10:32:07.977 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:61935b36:::smithi16036501-8:head# 2024-09-18T10:32:07.977 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 1a=[]:{} 2024-09-18T10:32:07.978 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:61b75516:::smithi16036501-13:26# 2024-09-18T10:32:07.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:61b75516:::smithi16036501-13:head# 2024-09-18T10:32:07.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 26=[]:{26=[26]} 2024-09-18T10:32:07.979 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:623b1fe4:::smithi16036501-43:head# 2024-09-18T10:32:07.979 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 26=[]:{} 2024-09-18T10:32:07.980 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:637715d3:::smithi16036501-41:head# 2024-09-18T10:32:07.980 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 6=[]:{} 2024-09-18T10:32:07.982 INFO:teuthology.orchestra.run.smithi071.stdout:Write 5#3:6fd2113e:::smithi16036501-26:head# 2024-09-18T10:32:07.982 INFO:teuthology.orchestra.run.smithi071.stdout:snapset 23=[]:{} 2024-09-18T10:32:07.985 INFO:teuthology.orchestra.run.smithi071.stdout:write_pg epoch 73 info 3.6s5( v 73'87 (0'0,73'87] local-lis/les=33/34 n=7 ec=33/33 lis/c=33/33 les/c/f=34/34/0 sis=33) 2024-09-18T10:32:07.986 INFO:teuthology.orchestra.run.smithi071.stdout:Import successful 2024-09-18T10:32:07.999 INFO:tasks.rados.rados.0.smithi160.stdout:298: finishing write tid 6 to smithi16036501-16 2024-09-18T10:32:07.999 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 16 v 116 (ObjNum 135 snap 24 seq_num 135) dirty exists 2024-09-18T10:32:07.999 INFO:tasks.rados.rados.0.smithi160.stdout:298: left oid 16 (ObjNum 135 snap 24 seq_num 135) 2024-09-18T10:32:08.003 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.003 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:32:08.071 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:08.069+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:08.110 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.110 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:32:08.170 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:08.169+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:32:08.271 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:08.270+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.323 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:32:08.372 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:08.371+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:08.428 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.428 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:32:08.473 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:08.472+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:08.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /var/log/ceph/exp.3.6s5.9 2024-09-18T10:32:08.535 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.536 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.536 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:32:08.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:32:08.573 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:08.572+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:08.610 INFO:tasks.rados.rados.0.smithi160.stdout:298: done (5 left) 2024-09-18T10:32:08.610 INFO:tasks.rados.rados.0.smithi160.stdout:299: done (4 left) 2024-09-18T10:32:08.610 INFO:tasks.rados.rados.0.smithi160.stdout:300: done (3 left) 2024-09-18T10:32:08.610 INFO:tasks.rados.rados.0.smithi160.stdout:301: done (2 left) 2024-09-18T10:32:08.610 INFO:tasks.rados.rados.0.smithi160.stdout:302: done (1 left) 2024-09-18T10:32:08.610 INFO:tasks.rados.rados.0.smithi160.stdout:303: done (0 left) 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:304: copy_from oid 7 from oid 19 current snap is 25 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:305: read oid 22 snap 24 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:305: expect (ObjNum 97 snap 13 seq_num 97) 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:306: rollback oid 11 current snap is 25 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 11 to 23 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:307: rollback oid 34 current snap is 25 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 34 to 23 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 27 current snap is 25 2024-09-18T10:32:08.611 INFO:tasks.rados.rados.0.smithi160.stdout:308: seq_num 136 ranges {0=737280,737280=770048,1507328=540672,2048000=245760} 2024-09-18T10:32:08.614 INFO:tasks.rados.rados.0.smithi160.stdout:308: writing smithi16036501-27 from 0 to 737280 tid 1 2024-09-18T10:32:08.618 INFO:tasks.rados.rados.0.smithi160.stdout:308: writing smithi16036501-27 from 737280 to 1507328 tid 2 2024-09-18T10:32:08.622 INFO:tasks.rados.rados.0.smithi160.stdout:308: writing smithi16036501-27 from 1507328 to 2048000 tid 3 2024-09-18T10:32:08.624 INFO:tasks.rados.rados.0.smithi160.stdout:308: writing smithi16036501-27 from 2048000 to 2293760 tid 4 2024-09-18T10:32:08.624 INFO:tasks.rados.rados.0.smithi160.stdout:309: rollback oid 48 current snap is 25 2024-09-18T10:32:08.624 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 48 to 23 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:307: finishing rollback tid 1 to smithi16036501-34 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 34 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:306: finishing rollback tid 1 to smithi16036501-11 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 11 v 0 (ObjNum 161 snap 0 seq_num 1) dirty dne 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:308: finishing write tid 1 to smithi16036501-27 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:306: done (5 left) 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:307: done (4 left) 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:310: read oid 20 snap -1 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:310: expect (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:311: rmattr oid 44 current snap is 25 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:311: done (5 left) 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 50 current snap is 25 2024-09-18T10:32:08.625 INFO:tasks.rados.rados.0.smithi160.stdout:312: seq_num 137 ranges {2523136=753664,3276800=786432,4063232=655360,4718592=114688} 2024-09-18T10:32:08.642 INFO:tasks.rados.rados.0.smithi160.stdout:312: writing smithi16036501-50 from 2523136 to 3276800 tid 1 2024-09-18T10:32:08.646 INFO:tasks.rados.rados.0.smithi160.stdout:312: writing smithi16036501-50 from 3276800 to 4063232 tid 2 2024-09-18T10:32:08.651 INFO:tasks.rados.rados.0.smithi160.stdout:312: writing smithi16036501-50 from 4063232 to 4718592 tid 3 2024-09-18T10:32:08.652 INFO:tasks.rados.rados.0.smithi160.stdout:312: writing smithi16036501-50 from 4718592 to 4833280 tid 4 2024-09-18T10:32:08.652 INFO:tasks.rados.rados.0.smithi160.stdout:313: rollback oid 47 current snap is 25 2024-09-18T10:32:08.652 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 47 to 24 2024-09-18T10:32:08.652 INFO:tasks.rados.rados.0.smithi160.stdout:308: finishing write tid 2 to smithi16036501-27 2024-09-18T10:32:08.652 INFO:tasks.rados.rados.0.smithi160.stdout:305: expect (ObjNum 97 snap 13 seq_num 97) 2024-09-18T10:32:08.674 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:08.673+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:08.689 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.689 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:32:08.733 INFO:tasks.rados.rados.0.smithi160.stdout:310: expect (ObjNum 49 snap 0 seq_num 49) 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:309: finishing rollback tid 0 to smithi16036501-48 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:308: finishing write tid 3 to smithi16036501-27 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:308: finishing write tid 4 to smithi16036501-27 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:308: finishing write tid 5 to smithi16036501-27 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:309: finishing rollback tid 1 to smithi16036501-48 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:309: finishing rollback tid 2 to smithi16036501-48 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 48 v 20 (ObjNum 128 snap 23 seq_num 128) dirty exists 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:308: finishing write tid 6 to smithi16036501-27 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 27 v 15 (ObjNum 136 snap 25 seq_num 136) dirty exists 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:308: left oid 27 (ObjNum 136 snap 25 seq_num 136) 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:312: finishing write tid 1 to smithi16036501-50 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:312: finishing write tid 2 to smithi16036501-50 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:305: done (6 left) 2024-09-18T10:32:08.755 INFO:tasks.rados.rados.0.smithi160.stdout:308: done (5 left) 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:309: done (4 left) 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:310: done (3 left) 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 2 current snap is 25 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:313: finishing rollback tid 1 to smithi16036501-47 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 47 v 0 (ObjNum 33 snap 0 seq_num 1704641912) dirty dne 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:312: finishing write tid 3 to smithi16036501-50 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:312: finishing write tid 4 to smithi16036501-50 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:312: finishing write tid 5 to smithi16036501-50 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:312: finishing write tid 6 to smithi16036501-50 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 50 v 37 (ObjNum 137 snap 25 seq_num 137) dirty exists 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:312: left oid 50 (ObjNum 137 snap 25 seq_num 137) 2024-09-18T10:32:08.756 INFO:tasks.rados.rados.0.smithi160.stdout:304: finishing copy_from racing read to smithi16036501-7 2024-09-18T10:32:08.757 INFO:tasks.rados.rados.0.smithi160.stdout:304: finishing copy_from to smithi16036501-7 2024-09-18T10:32:08.757 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 7 v 63 (ObjNum 122 snap 20 seq_num 122) dirty exists 2024-09-18T10:32:08.757 INFO:tasks.rados.rados.0.smithi160.stdout:314: seq_num 138 ranges {32768=770048,802816=540672,1343488=753664,2097152=262144} 2024-09-18T10:32:08.758 INFO:tasks.rados.rados.0.smithi160.stdout:314: writing smithi16036501-2 from 32768 to 802816 tid 1 2024-09-18T10:32:08.761 INFO:tasks.rados.rados.0.smithi160.stdout:314: writing smithi16036501-2 from 802816 to 1343488 tid 2 2024-09-18T10:32:08.766 INFO:tasks.rados.rados.0.smithi160.stdout:314: writing smithi16036501-2 from 1343488 to 2097152 tid 3 2024-09-18T10:32:08.768 INFO:tasks.rados.rados.0.smithi160.stdout:314: writing smithi16036501-2 from 2097152 to 2359296 tid 4 2024-09-18T10:32:08.768 INFO:tasks.rados.rados.0.smithi160.stdout:304: done (3 left) 2024-09-18T10:32:08.768 INFO:tasks.rados.rados.0.smithi160.stdout:312: done (2 left) 2024-09-18T10:32:08.768 INFO:tasks.rados.rados.0.smithi160.stdout:313: done (1 left) 2024-09-18T10:32:08.768 INFO:tasks.rados.rados.0.smithi160.stdout:315: copy_from oid 17 from oid 8 current snap is 25 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:314: finishing write tid 1 to smithi16036501-2 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:316: read oid 25 snap -1 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:316: expect (ObjNum 60 snap 1 seq_num 60) 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:317: read oid 30 snap -1 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:317: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 47 current snap is 25 2024-09-18T10:32:08.769 INFO:tasks.rados.rados.0.smithi160.stdout:318: seq_num 139 ranges {0=786432,786432=688128,1474560=475136,1949696=393216} 2024-09-18T10:32:08.773 INFO:tasks.rados.rados.0.smithi160.stdout:318: writing smithi16036501-47 from 0 to 786432 tid 1 2024-09-18T10:32:08.775 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:08.774+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:08.778 INFO:tasks.rados.rados.0.smithi160.stdout:318: writing smithi16036501-47 from 786432 to 1474560 tid 2 2024-09-18T10:32:08.781 INFO:tasks.rados.rados.0.smithi160.stdout:318: writing smithi16036501-47 from 1474560 to 1949696 tid 3 2024-09-18T10:32:08.784 INFO:tasks.rados.rados.0.smithi160.stdout:318: writing smithi16036501-47 from 1949696 to 2342912 tid 4 2024-09-18T10:32:08.784 INFO:tasks.rados.rados.0.smithi160.stdout:319: setattr oid 18 current snap is 25 2024-09-18T10:32:08.784 INFO:tasks.rados.rados.0.smithi160.stdout:314: finishing write tid 2 to smithi16036501-2 2024-09-18T10:32:08.784 INFO:tasks.rados.rados.0.smithi160.stdout:314: finishing write tid 3 to smithi16036501-2 2024-09-18T10:32:08.784 INFO:tasks.rados.rados.0.smithi160.stdout:315: finishing copy_from racing read to smithi16036501-17 2024-09-18T10:32:08.784 INFO:tasks.rados.rados.0.smithi160.stdout:316: expect (ObjNum 60 snap 1 seq_num 60) 2024-09-18T10:32:08.804 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.804 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:32:08.821 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:32:08.828 INFO:tasks.rados.rados.0.smithi160.stdout:317: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-18T10:32:08.839 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:32:08.839 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:32:08.603814+0000","last_up_change":"2024-09-18T10:32:00.685704+0000","last_in_change":"2024-09-18T10:32:01.692062+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-09-18T10:31:17.263911+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":49,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":0,"in":0,"weight":0,"primary_affinity":0.0227203369140625,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":32743},{"type":"v1","addr":"172.21.15.71:6810","nonce":32743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":32743},{"type":"v1","addr":"172.21.15.71:6814","nonce":32743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":32743},{"type":"v1","addr":"172.21.15.71:6822","nonce":32743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":32743},{"type":"v1","addr":"172.21.15.71:6818","nonce":32743}]},"public_addr":"172.21.15.71:6810/32743","cluster_addr":"172.21.15.71:6814/32743","heartbeat_back_addr":"172.21.15.71:6822/32743","heartbeat_front_addr":"172.21.15.71:6818/32743","state":["exists"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.990432+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.001886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.111884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.061397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:57.963684+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:06.953638+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:04.067522+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:03.953892+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.011033+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":65536,"last_purged_snaps_scrub":"2024-09-18T10:30:58.090509+0000","dead_epoch":76},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.057952+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:00.977419+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.024718+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.029645+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.093324+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.008295+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":38,"length":2},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":46,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:314: finishing write tid 4 to smithi16036501-2 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:315: finishing copy_from to smithi16036501-17 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 54 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:314: finishing write tid 5 to smithi16036501-2 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:314: finishing write tid 6 to smithi16036501-2 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 2 v 24 (ObjNum 138 snap 25 seq_num 138) dirty exists 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:314: left oid 2 (ObjNum 138 snap 25 seq_num 138) 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:318: finishing write tid 1 to smithi16036501-47 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:318: finishing write tid 2 to smithi16036501-47 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:318: finishing write tid 3 to smithi16036501-47 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:318: finishing write tid 4 to smithi16036501-47 2024-09-18T10:32:08.842 INFO:tasks.rados.rados.0.smithi160.stdout:318: finishing write tid 5 to smithi16036501-47 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:318: finishing write tid 6 to smithi16036501-47 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 47 v 9 (ObjNum 139 snap 25 seq_num 139) dirty exists 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:318: left oid 47 (ObjNum 139 snap 25 seq_num 139) 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:314: done (5 left) 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:315: done (4 left) 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:316: done (3 left) 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:317: done (2 left) 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:318: done (1 left) 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:320: delete oid 32 current snap is 25 2024-09-18T10:32:08.843 INFO:tasks.rados.rados.0.smithi160.stdout:320: done (1 left) 2024-09-18T10:32:08.844 INFO:tasks.rados.rados.0.smithi160.stdout:321: snap_remove snap 24 2024-09-18T10:32:08.853 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T10:31:00.658279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-18T10:31:03.266294+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 29, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-18T10:31:17.263911+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 3, 'size': 7, 'min_size': 5, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 84, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'shecprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 16384, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}] 2024-09-18T10:32:08.853 DEBUG:teuthology.orchestra.run.smithi071:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal --op apply-layout-settings --pool .mgr 2024-09-18T10:32:08.876 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:08.875+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:08.944 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:08.950 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:08.951 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:08.958 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:08.958 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:08.959 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:32:08.974 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:08.975 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:08.977 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:08.976+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:08.991 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:08.991 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:09.006 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:09.022 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:09.022 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:09.038 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:09.038 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:09.053 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:32:09.059 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 39.744079483999997, 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064675760000000001, 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.060 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313489+0000", 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313515+0000", 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6261000000000001e-05 2024-09-18T10:32:09.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313533+0000", 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7538e-05 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313542+0000", 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4509999999999998e-06 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.062 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313600+0000", 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7883999999999997e-05 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313610+0000", 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7319999999999993e-06 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319944+0000", 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063339829999999996 2024-09-18T10:32:09.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319957+0000", 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/33 ECSubWrite(tid=53, reqid=client.4589.0:299, at_version=45'45, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 38.729159897000002, 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056329550000000003, 2024-09-18T10:32:09.064 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.066 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328408+0000", 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328607+0000", 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00019832300000000001 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328623+0000", 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6240999999999999e-05 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328633+0000", 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0015e-05 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328719+0000", 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.6198000000000004e-05 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328731+0000", 2024-09-18T10:32:09.068 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2055000000000001e-05 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334030+0000", 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052983739999999998 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334042+0000", 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2646999999999999e-05 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.069 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=72, reqid=osd.3.0:72, at_version=60'60, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 24.454186189000001, 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058652940000000001, 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.071 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603404+0000", 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1523e-05 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603416+0000", 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1263999999999999e-05 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603424+0000", 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0420000000000003e-06 2024-09-18T10:32:09.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603495+0000", 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1149999999999995e-05 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603505+0000", 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8579999999999995e-06 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.073 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609223+0000", 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057186440000000002 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609248+0000", 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5168999999999999e-05 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=73, reqid=osd.3.0:73, at_version=60'62, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 24.453200506000002, 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058440569999999997, 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604368+0000", 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.076 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604387+0000", 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9375999999999999e-05 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604401+0000", 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3591000000000001e-05 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604407+0000", 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7379999999999999e-06 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604451+0000", 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4082999999999998e-05 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604460+0000", 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3500000000000003e-06 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.078 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610197+0000", 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057371849999999997 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610213+0000", 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5522000000000001e-05 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.079 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/33 ECSubWrite(tid=138, reqid=osd.13.0:138, at_version=60'64, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 24.437606548000002, 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0087157520000000002, 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.080 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619962+0000", 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619982+0000", 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9661e-05 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619994+0000", 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.205e-05 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620000+0000", 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8100000000000003e-06 2024-09-18T10:32:09.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620036+0000", 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6171000000000003e-05 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620042+0000", 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8560000000000003e-06 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628654+0000", 2024-09-18T10:32:09.083 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0086122119999999993 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628678+0000", 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4586000000000001e-05 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=76, reqid=osd.3.0:75, at_version=0'0, trim_to=0'0, roll_forward_to=60'64))", 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:32:09.084 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 24.435455231999999, 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065928169999999999, 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622113+0000", 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622124+0000", 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1199999999999999e-05 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622137+0000", 2024-09-18T10:32:09.086 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2866e-05 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622145+0000", 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2560000000000002e-06 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622196+0000", 2024-09-18T10:32:09.087 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0878000000000003e-05 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622207+0000", 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.11e-05 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628685+0000", 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064776080000000002 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.088 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628707+0000", 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1889999999999999e-05 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 71/33 ECSubWrite(tid=171, reqid=client.4589.0:561, at_version=71'80, trim_to=0'0, roll_forward_to=64'78))", 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:09.089 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 13.443809870000001, 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059379360000000004, 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.090 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614740+0000", 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00098056300000000005 2024-09-18T10:32:09.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614798+0000", 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8467000000000001e-05 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614809+0000", 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1014e-05 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.092 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614906+0000", 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.6414000000000002e-05 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614917+0000", 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.146e-05 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.619658+0000", 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004740368 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.619697+0000", 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9765000000000003e-05 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 71/33 ECSubWrite(tid=88, reqid=client.4589.0:573, at_version=71'74, trim_to=0'0, roll_forward_to=64'72))", 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 13.433153110999999, 2024-09-18T10:32:09.094 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0061339209999999996, 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624415+0000", 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624669+0000", 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00025409299999999999 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624690+0000", 2024-09-18T10:32:09.096 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.092e-05 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624698+0000", 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.695e-06 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624777+0000", 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9548999999999993e-05 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.097 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624785+0000", 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7889999999999995e-06 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.630522+0000", 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057368669999999997 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.630550+0000", 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7943999999999999e-05 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 71/33 ECSubWrite(tid=176, reqid=client.4589.0:583, at_version=71'85, trim_to=0'0, roll_forward_to=71'82))", 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 13.374515822999999, 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0060182889999999996, 2024-09-18T10:32:09.099 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683068+0000", 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5600999999999999e-05 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.101 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683079+0000", 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0433e-05 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683084+0000", 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1279999999999999e-06 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683401+0000", 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00031686000000000003 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683408+0000", 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6930000000000001e-06 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.689028+0000", 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056205059999999999 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.689072+0000", 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3671999999999998e-05 2024-09-18T10:32:09.103 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=114, reqid=osd.0.0:114, at_version=75'91, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.701064+0000", 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3565049140000003, 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010252013000000001, 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.104 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701064+0000", 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701064+0000", 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701063+0000", 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701100+0000", 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6189999999999997e-05 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701116+0000", 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6150999999999998e-05 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701123+0000", 2024-09-18T10:32:09.106 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6179999999999997e-06 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701432+0000", 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030811199999999998 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701443+0000", 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1622e-05 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711289+0000", 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0098456040000000009 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711316+0000", 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7608999999999999e-05 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=115, reqid=client.4589.0:658, at_version=75'92, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.702412+0000", 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.355157578, 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089212700000000002, 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702412+0000", 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702412+0000", 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702411+0000", 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703060+0000", 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00064883699999999998 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.110 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703072+0000", 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2567e-05 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703077+0000", 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0690000000000001e-06 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703117+0000", 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9557000000000001e-05 2024-09-18T10:32:09.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703124+0000", 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9460000000000001e-06 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711321+0000", 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081973819999999996 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.112 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711333+0000", 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1684e-05 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 75/33 ECSubWrite(tid=70, reqid=osd.8.0:70, at_version=75'61, trim_to=0'0, roll_forward_to=73'59))", 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3515459530000005, 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072873649999999996, 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.113 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.114 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706040+0000", 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6949999999999999e-05 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706053+0000", 2024-09-18T10:32:09.115 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2745000000000001e-05 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706059+0000", 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3149999999999997e-06 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706109+0000", 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.116 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706116+0000", 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1790000000000002e-06 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.713282+0000", 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0071660170000000002 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.713311+0000", 2024-09-18T10:32:09.117 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8617000000000001e-05 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=116, reqid=client.4589.0:659, at_version=75'93, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.706473+0000", 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3510962240000008, 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085839699999999998, 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.118 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706473+0000", 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706473+0000", 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706472+0000", 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706822+0000", 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00034966100000000003 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706836+0000", 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4178e-05 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706843+0000", 2024-09-18T10:32:09.120 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0589999999999997e-06 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706894+0000", 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0763000000000002e-05 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706905+0000", 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1454000000000001e-05 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.121 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715029+0000", 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081234280000000002 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715057+0000", 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8450999999999999e-05 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=117, reqid=client.4589.0:660, at_version=75'94, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.122 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.707407+0000", 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3501621799999999, 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0076666390000000003, 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707407+0000", 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.123 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707407+0000", 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707406+0000", 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707440+0000", 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3365000000000003e-05 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.124 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707452+0000", 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2678e-05 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707459+0000", 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6080000000000001e-06 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709619+0000", 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021602570000000001 2024-09-18T10:32:09.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709630+0000", 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.063e-05 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715062+0000", 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054324780000000001 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.126 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715074+0000", 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1528999999999999e-05 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 75/33 ECSubWrite(tid=99, reqid=osd.3.0:99, at_version=75'82, trim_to=0'0, roll_forward_to=73'80))", 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3496359279999997, 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0071916009999999997, 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.127 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:09.128 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707961+0000", 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7841e-05 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707978+0000", 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7e-05 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.129 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707985+0000", 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8009999999999998e-06 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708048+0000", 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3507e-05 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708060+0000", 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1418e-05 2024-09-18T10:32:09.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715088+0000", 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070287029999999999 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715125+0000", 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6672999999999999e-05 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 75/33 ECSubWrite(tid=198, reqid=osd.13.0:198, at_version=75'99, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3494344189999996, 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070372610000000004, 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:09.132 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.133 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708181+0000", 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6687000000000002e-05 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708197+0000", 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5696999999999999e-05 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708205+0000", 2024-09-18T10:32:09.134 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0630000000000006e-06 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708272+0000", 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7280000000000006e-05 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708282+0000", 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4290000000000007e-06 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.135 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715141+0000", 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0068589810000000001 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715172+0000", 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1374999999999997e-05 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.136 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=118, reqid=client.4589.0:661, at_version=75'95, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.708697+0000", 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3488722230000008, 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064301979999999998, 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708697+0000", 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.137 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708697+0000", 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708696+0000", 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708713+0000", 2024-09-18T10:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6572999999999999e-05 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708725+0000", 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2098e-05 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708731+0000", 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1840000000000004e-06 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.139 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711034+0000", 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023025879999999999 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711044+0000", 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0135e-05 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715108+0000", 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0040643770000000001 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.140 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715127+0000", 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9097999999999999e-05 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 75/33 ECSubWrite(tid=199, reqid=osd.13.0:199, at_version=75'101, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.709162+0000", 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3484070369999994, 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00659912, 2024-09-18T10:32:09.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709162+0000", 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709162+0000", 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.142 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709161+0000", 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709178+0000", 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6229999999999999e-05 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709189+0000", 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.101e-05 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0419999999999999e-06 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711488+0000", 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022928610000000002 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711497+0000", 2024-09-18T10:32:09.144 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3589999999999997e-06 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715740+0000", 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042433560000000002 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715761+0000", 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1043000000000002e-05 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s6 75/33 ECSubWrite(tid=345, reqid=osd.4.0:345, at_version=75'60, trim_to=0'0, roll_forward_to=73'58))", 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.710066+0000", 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.3475036320000005, 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056680639999999996, 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710066+0000", 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.147 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.147 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710066+0000", 2024-09-18T10:32:09.147 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710065+0000", 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.148 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710085+0000", 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9321999999999999e-05 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711269+0000", 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011847299999999999 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711277+0000", 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1339999999999998e-06 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.712858+0000", 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001581378 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.712868+0000", 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0458e-05 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715712+0000", 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028439910000000001 2024-09-18T10:32:09.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715734+0000", 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1330000000000001e-05 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s6 76/33 ECSubWrite(tid=356, reqid=client.4589.0:681, at_version=76'65, trim_to=0'0, roll_forward_to=76'62))", 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 8.3422859250000005, 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065754630000000001, 2024-09-18T10:32:09.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715307+0000", 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4057e-05 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715322+0000", 2024-09-18T10:32:09.153 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5187e-05 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715329+0000", 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0690000000000004e-06 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715375+0000", 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6078000000000002e-05 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.154 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715386+0000", 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0739e-05 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721831+0000", 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064451680000000003 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721859+0000", 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7903e-05 2024-09-18T10:32:09.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.156 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.156 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.156 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.156 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.156 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:09.157 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:09.158 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:09.156+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:09.159 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:09.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:32:09.160 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:09.160 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:09.161 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:09.161 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:09.162 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:09.163 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:09.163 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:09.163 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:09.163 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:09.166 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:09.167 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:09.258 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:09.257+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:09.259 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:09.259 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:09.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:32:09.359 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:09.358+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:09.365 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:32:09.365 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:32:09.365 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:09.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:32:09.460 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:09.459+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:32:09.473 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 67.410122224000006, 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76442072000000005, 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:32:09.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060653+0000", 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.475 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060661+0000", 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4030000000000007e-06 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060672+0000", 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060691+0000", 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8553e-05 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060740+0000", 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060747+0000", 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1399999999999997e-06 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.823811+0000", 2024-09-18T10:32:09.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76306395100000002 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824007+0000", 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000196737 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824158+0000", 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000150913 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.478 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824701+0000", 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054279800000000004 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825007+0000", 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030596600000000002 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825044+0000", 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6853000000000001e-05 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825075+0000", 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1102000000000001e-05 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:09.480 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.475330338000006, 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089361909999999996, 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 47 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:09.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995550+0000", 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000104314 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995559+0000", 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7069999999999998e-06 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995568+0000", 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1479999999999995e-06 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999298+0000", 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037306729999999999 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999379+0000", 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0304999999999998e-05 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999486+0000", 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010773299999999999 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.484 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001630+0000", 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021436200000000002 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004321+0000", 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0026907049999999998 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004355+0000", 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4591000000000001e-05 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004382+0000", 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6869999999999999e-05 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.475181077000002, 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089699740000000003, 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.486 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 49 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.487 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995598+0000", 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.495e-06 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.488 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995604+0000", 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4160000000000003e-06 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995607+0000", 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.439e-06 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000235+0000", 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046279570000000003 2024-09-18T10:32:09.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000284+0000", 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8316000000000003e-05 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000364+0000", 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0117999999999994e-05 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002075+0000", 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001711064 2024-09-18T10:32:09.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004511+0000", 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024360699999999998 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004542+0000", 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0998999999999999e-05 2024-09-18T10:32:09.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004565+0000", 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3458000000000001e-05 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.475163825999999, 2024-09-18T10:32:09.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011464667, 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 50 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995612+0000", 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995711+0000", 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8493999999999996e-05 2024-09-18T10:32:09.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995719+0000", 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4160000000000004e-06 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995724+0000", 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000646+0000", 2024-09-18T10:32:09.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049220560000000002 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000740+0000", 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4660999999999994e-05 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000883+0000", 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00014210199999999999 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.496 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002077+0000", 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011947150000000001 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007015+0000", 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049376560000000003 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007053+0000", 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8469e-05 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.497 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007077+0000", 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3876999999999999e-05 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.475045395999999, 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011450287999999999, 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.498 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 51 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:32:09.499 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995730+0000", 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995735+0000", 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.938e-06 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.500 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995741+0000", 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995744+0000", 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2729999999999998e-06 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001284+0000", 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00553982 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.501 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001354+0000", 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9439999999999999e-05 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001433+0000", 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9839000000000006e-05 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002242+0000", 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080809000000000002 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007122+0000", 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004880428 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007150+0000", 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8309999999999998e-05 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007181+0000", 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1059000000000002e-05 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.503 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.475026994999993, 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011502327, 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.504 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 52 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995754+0000", 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1610000000000002e-06 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995760+0000", 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.506 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995764+0000", 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6739999999999999e-06 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001659+0000", 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058952459999999998 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.507 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001742+0000", 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2378000000000003e-05 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001835+0000", 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3710999999999998e-05 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002405+0000", 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056997199999999997 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.508 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007206+0000", 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048005959999999999 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007231+0000", 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5449999999999999e-05 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.509 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007252+0000", 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0319e-05 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:09.510 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.340917485000006, 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010184168, 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 71 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:09.511 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.512 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129861+0000", 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1019999999999999e-06 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129864+0000", 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.898e-06 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129866+0000", 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0339999999999999e-06 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.513 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133579+0000", 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037133029999999998 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133627+0000", 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7700000000000001e-05 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133711+0000", 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3752999999999996e-05 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.514 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136265+0000", 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025542759999999999 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.139993+0000", 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003728543 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140023+0000", 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0103999999999998e-05 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140043+0000", 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.340908108999997, 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286735, 2024-09-18T10:32:09.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 72 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.517 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129937+0000", 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8833999999999999e-05 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129943+0000", 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6710000000000004e-06 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129946+0000", 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2480000000000001e-06 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133930+0000", 2024-09-18T10:32:09.519 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039838319999999997 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133979+0000", 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9802999999999997e-05 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134057+0000", 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7226999999999998e-05 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.520 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136267+0000", 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022104440000000002 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140087+0000", 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038197069999999999 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140117+0000", 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0156000000000001e-05 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.521 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140155+0000", 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8019000000000003e-05 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.340826402999994, 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286248, 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.522 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 73 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.523 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129952+0000", 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7420000000000002e-06 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.524 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129956+0000", 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0289999999999999e-06 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129959+0000", 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134509+0000", 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045500389999999996 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134554+0000", 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4984999999999997e-05 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134633+0000", 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8549999999999998e-05 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136269+0000", 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016365489999999999 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.526 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140192+0000", 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039229299999999998 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140217+0000", 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4992000000000001e-05 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140236+0000", 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.895e-05 2024-09-18T10:32:09.527 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.340791569000004, 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010335796, 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.528 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 74 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.529 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129984+0000", 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129989+0000", 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5680000000000001e-06 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129995+0000", 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3350000000000003e-06 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129999+0000", 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9500000000000003e-06 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134856+0000", 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048568020000000003 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134907+0000", 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1450999999999999e-05 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134984+0000", 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6379999999999997e-05 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136272+0000", 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012878449999999999 2024-09-18T10:32:09.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140264+0000", 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039928409999999996 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140289+0000", 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4652999999999999e-05 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140321+0000", 2024-09-18T10:32:09.533 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1550000000000001e-05 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.340763168999999, 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.01270772, 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.534 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 75 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130094+0000", 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1198000000000004e-05 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130104+0000", 2024-09-18T10:32:09.536 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5789999999999993e-06 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130114+0000", 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0808000000000001e-05 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135231+0000", 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051164119999999999 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135281+0000", 2024-09-18T10:32:09.537 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0305e-05 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135363+0000", 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2083999999999995e-05 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136275+0000", 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091162199999999995 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.538 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142660+0000", 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063848919999999997 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142698+0000", 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8804999999999999e-05 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142721+0000", 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2498e-05 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.539 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.340654372000003, 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.015446817, 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 76 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130121+0000", 2024-09-18T10:32:09.541 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130128+0000", 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.161e-06 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130135+0000", 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8189999999999992e-06 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.542 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130139+0000", 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7340000000000002e-06 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135853+0000", 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057137840000000004 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135902+0000", 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9461e-05 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.543 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135979+0000", 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6268999999999998e-05 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136467+0000", 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048846600000000001 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145517+0000", 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0090497459999999991 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.544 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145546+0000", 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9295999999999999e-05 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145569+0000", 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2697e-05 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.076334282000005, 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091240130000000003, 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 121 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.546 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.547 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394445+0000", 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.292e-06 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394448+0000", 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0819999999999999e-06 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394450+0000", 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9420000000000002e-06 2024-09-18T10:32:09.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399432+0000", 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049813349999999999 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399474+0000", 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2061000000000003e-05 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399540+0000", 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6324999999999999e-05 2024-09-18T10:32:09.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403485+0000", 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039450300000000004 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403519+0000", 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3794000000000002e-05 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403547+0000", 2024-09-18T10:32:09.550 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8195999999999999e-05 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403566+0000", 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9236999999999999e-05 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.076323793, 2024-09-18T10:32:09.551 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0092440720000000007, 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 122 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.552 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394452+0000", 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394455+0000", 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.728e-06 2024-09-18T10:32:09.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394460+0000", 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1089999999999997e-06 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.554 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.555 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394463+0000", 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0939999999999999e-06 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399744+0000", 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052808059999999999 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.556 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399814+0000", 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9710999999999997e-05 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399928+0000", 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000113885 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403609+0000", 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036813979999999998 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.557 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403616+0000", 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7390000000000002e-06 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403658+0000", 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2373000000000002e-05 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403697+0000", 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8435e-05 2024-09-18T10:32:09.558 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.076301502000007, 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011099146000000001, 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.559 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 123 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.560 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394505+0000", 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0673999999999998e-05 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394511+0000", 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5539999999999997e-06 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.561 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394513+0000", 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.52e-06 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400185+0000", 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056715170000000001 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400227+0000", 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2512999999999998e-05 2024-09-18T10:32:09.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400322+0000", 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4887000000000001e-05 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403719+0000", 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033967540000000001 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405497+0000", 2024-09-18T10:32:09.563 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001778204 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405542+0000", 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4502000000000002e-05 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405574+0000", 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.564 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 66.076259346000001, 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.016509943999999999, 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 124 2024-09-18T10:32:09.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:09.566 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394519+0000", 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.508e-06 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394522+0000", 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.83e-06 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.567 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394524+0000", 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.804e-06 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403059+0000", 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085345979999999991 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403129+0000", 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0043999999999995e-05 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.568 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403245+0000", 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000116123 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.404743+0000", 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001498309 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410948+0000", 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062045370000000004 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.569 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410993+0000", 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5629e-05 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.411027+0000", 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3827e-05 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.570 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s2 75/33 ECSubWrite(tid=114, reqid=osd.0.0:114, at_version=75'91, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.701184+0000", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.7695919409999998, 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010483292, 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701184+0000", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701184+0000", 2024-09-18T10:32:09.571 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701183+0000", 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701211+0000", 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8085999999999998e-05 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.572 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701223+0000", 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1599e-05 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701230+0000", 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.849e-06 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701280+0000", 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0614e-05 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.573 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701290+0000", 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5429999999999999e-06 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711641+0000", 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010350546 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711668+0000", 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7209e-05 2024-09-18T10:32:09.574 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s2 75/33 ECSubWrite(tid=115, reqid=client.4589.0:658, at_version=75'92, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.702490+0000", 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.7682868929999991, 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091997079999999992, 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.575 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702490+0000", 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702490+0000", 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702489+0000", 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.576 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703378+0000", 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00088902700000000002 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703395+0000", 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6888000000000002e-05 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703402+0000", 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3069999999999997e-06 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.704936+0000", 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0015342859999999999 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.704946+0000", 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.798e-06 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711672+0000", 2024-09-18T10:32:09.578 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0067261930000000001 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711689+0000", 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7082999999999999e-05 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4589.0:718 3.8s0 3:15f078d6:::smithi16036501-48:head [append 0~606208] snapc 2e=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:06.615576+0000", 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 2.8552000230000001, 2024-09-18T10:32:09.579 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0096284079999999998, 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4589", 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 718 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.615576+0000", 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.580 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.615576+0000", 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.615570+0000", 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999933 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616881+0000", 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013116250000000001 2024-09-18T10:32:09.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616900+0000", 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8938999999999999e-05 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616908+0000", 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3990000000000004e-06 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616990+0000", 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1346000000000003e-05 2024-09-18T10:32:09.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op must wait for map", 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616998+0000", 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4179999999999997e-06 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.617802+0000", 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000804012 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.617890+0000", 2024-09-18T10:32:09.583 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7502000000000003e-05 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.619270+0000", 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013801040000000001 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.622103+0000", 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028329779999999999 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:09.584 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.625107+0000", 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0030046000000000001 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.625205+0000", 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7381999999999997e-05 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4589.0:723 3.8s0 3:15f078d6:::smithi16036501-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:09.585 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 2.8442981010000001, 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011891406, 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "started", 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4589", 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 723 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626481+0000", 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4680000000000001e-06 2024-09-18T10:32:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626488+0000", 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2709999999999998e-06 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626491+0000", 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7100000000000001e-06 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.628927+0000", 2024-09-18T10:32:09.588 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024354979999999999 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.628986+0000", 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9135000000000002e-05 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.634864+0000", 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.005877925 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:09.589 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.634918+0000", 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4101000000000003e-05 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.638370+0000", 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0034517570000000002 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.590 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:09.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:32:09.592 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:09.591+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:09.608 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:32:09.613 INFO:tasks.rados.rados.0.smithi160.stdout:321: done (1 left) 2024-09-18T10:32:09.614 INFO:tasks.rados.rados.0.smithi160.stdout:322: read oid 49 snap -1 2024-09-18T10:32:09.614 INFO:tasks.rados.rados.0.smithi160.stdout:322: expect deleted 2024-09-18T10:32:09.614 INFO:tasks.rados.rados.0.smithi160.stdout:323: snap_create 2024-09-18T10:32:09.614 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 18 v 47 (ObjNum 99 snap 14 seq_num 99) dirty exists 2024-09-18T10:32:09.692 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:09.691+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:09.693 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.693 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:09.694 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:09.694 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:09.702 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:32:09.794 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:09.793+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:09.839 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:32:09.839 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:32:09.839 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:09.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:32:09.894 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:09.894+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:09.941 INFO:teuthology.orchestra.run.smithi071.stderr:Nothing to do for non-filestore backend 2024-09-18T10:32:09.946 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:09.946 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.629810278000001, 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054360959999999996, 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.947 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314517+0000", 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.948 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314545+0000", 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7441e-05 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314558+0000", 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2716e-05 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314564+0000", 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7190000000000004e-06 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314614+0000", 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9595000000000002e-05 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314623+0000", 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9889999999999998e-06 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.950 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319931+0000", 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053084439999999998 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319954+0000", 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3073000000000001e-05 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:32:09.951 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.626833783000002, 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00557647, 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.952 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317494+0000", 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317507+0000", 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.953 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317522+0000", 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.45e-05 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317529+0000", 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4619999999999999e-06 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317587+0000", 2024-09-18T10:32:09.954 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7552000000000001e-05 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317597+0000", 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8810000000000008e-06 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323054+0000", 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054572689999999998 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.955 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323071+0000", 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7435000000000002e-05 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 44/33 ECSubWrite(tid=21, reqid=osd.8.0:21, at_version=44'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.625060363999999, 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063338889999999997, 2024-09-18T10:32:09.956 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.957 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319300+0000", 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1572000000000002e-05 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319313+0000", 2024-09-18T10:32:09.958 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3832000000000001e-05 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319322+0000", 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1419999999999999e-06 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319384+0000", 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1598000000000002e-05 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.959 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319394+0000", 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8079999999999999e-06 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325566+0000", 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006172192 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325602+0000", 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6075999999999998e-05 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.960 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.963 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 39.603490694000001, 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054953399999999996, 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:32:09.964 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340837+0000", 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.965 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341640+0000", 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080260699999999999 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341653+0000", 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3579e-05 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341665+0000", 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1549000000000001e-05 2024-09-18T10:32:09.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341728+0000", 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2787999999999996e-05 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341738+0000", 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0380000000000001e-05 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346306+0000", 2024-09-18T10:32:09.967 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045678009999999998 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346333+0000", 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7606999999999998e-05 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=132, reqid=client.4589.0:311, at_version=45'33, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 39.600598605999998, 2024-09-18T10:32:09.968 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006336899, 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343729+0000", 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344271+0000", 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054216699999999997 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344284+0000", 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2551999999999999e-05 2024-09-18T10:32:09.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344290+0000", 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5599999999999999e-06 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344376+0000", 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5834000000000005e-05 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.971 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344387+0000", 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0942e-05 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350040+0000", 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056529889999999998 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350067+0000", 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6857999999999999e-05 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.972 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 39.598999468999999, 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0074420069999999996, 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:32:09.973 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345328+0000", 2024-09-18T10:32:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345430+0000", 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010200399999999999 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345444+0000", 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3827e-05 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.975 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345454+0000", 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5219999999999996e-06 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346383+0000", 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00092949799999999996 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346395+0000", 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1858999999999999e-05 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.976 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352753+0000", 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063576789999999998 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352771+0000", 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8556999999999999e-05 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.977 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=134, reqid=client.4589.0:313, at_version=45'35, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 39.597852674999999, 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063042000000000003, 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:32:09.978 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346475+0000", 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.979 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346495+0000", 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9876000000000001e-05 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346507+0000", 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2407e-05 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346514+0000", 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7220000000000002e-06 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.980 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346794+0000", 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00028027400000000001 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346807+0000", 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2388999999999999e-05 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352774+0000", 2024-09-18T10:32:09.981 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059673729999999998 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352780+0000", 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1279999999999996e-06 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=135, reqid=client.4589.0:302, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:32:09.982 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 39.597117427000001, 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055314830000000002, 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.983 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347210+0000", 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347224+0000", 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3794e-05 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.984 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347239+0000", 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5313000000000001e-05 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347246+0000", 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7700000000000004e-06 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347295+0000", 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8534e-05 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.985 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347306+0000", 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1224e-05 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352720+0000", 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054135549999999996 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352743+0000", 2024-09-18T10:32:09.986 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3156999999999999e-05 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 35.343223584999997, 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053213160000000004, 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.987 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601104+0000", 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.988 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601311+0000", 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000206684 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601324+0000", 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3562e-05 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601330+0000", 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3630000000000002e-06 2024-09-18T10:32:09.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601373+0000", 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3516000000000001e-05 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601380+0000", 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6109999999999999e-06 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606405+0000", 2024-09-18T10:32:09.990 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050246329999999997 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606426+0000", 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1841e-05 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 35.341841084000002, 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064992319999999998, 2024-09-18T10:32:09.991 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.992 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602487+0000", 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602544+0000", 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7605000000000002e-05 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602559+0000", 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4873e-05 2024-09-18T10:32:09.993 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602566+0000", 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0180000000000004e-06 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603204+0000", 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00063799400000000002 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.994 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603216+0000", 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1888e-05 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608951+0000", 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057352130000000003 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608987+0000", 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5417000000000003e-05 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:09.995 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=195, reqid=client.4589.0:427, at_version=55'49, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 30.275451679, 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0073182050000000004, 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.996 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669388+0000", 2024-09-18T10:32:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051155899999999997 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669401+0000", 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2711000000000001e-05 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669409+0000", 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6580000000000002e-06 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:09.998 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669465+0000", 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5994e-05 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669472+0000", 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.695e-06 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676164+0000", 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0066911820000000004 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:09.999 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676195+0000", 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1532000000000002e-05 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=196, reqid=client.4589.0:428, at_version=55'50, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 30.271454876, 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057749089999999999, 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.000 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.001 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672873+0000", 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673445+0000", 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00057173499999999997 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673456+0000", 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1579999999999999e-05 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.002 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673463+0000", 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7320000000000001e-06 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673504+0000", 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0636999999999997e-05 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673516+0000", 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2187e-05 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.003 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678624+0000", 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051085599999999998 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678649+0000", 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4375999999999998e-05 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.004 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/33 ECSubWrite(tid=55, reqid=osd.8.0:55, at_version=60'46, trim_to=0'0, roll_forward_to=59'44))", 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.339652523000002, 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056724729999999999, 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.005 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604700+0000", 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4581999999999999e-05 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.006 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604710+0000", 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2399999999999996e-06 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604715+0000", 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5910000000000003e-06 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604763+0000", 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7939999999999998e-05 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.007 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604774+0000", 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0698e-05 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610328+0000", 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055546199999999997 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610349+0000", 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0162000000000001e-05 2024-09-18T10:32:10.008 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/33 ECSubWrite(tid=57, reqid=osd.8.0:56, at_version=0'0, trim_to=0'0, roll_forward_to=60'48))", 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.327448428, 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064620900000000002, 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.009 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616879+0000", 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.010 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616892+0000", 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2843000000000001e-05 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616905+0000", 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3203e-05 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616911+0000", 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0589999999999999e-06 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616965+0000", 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4148999999999999e-05 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616972+0000", 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2589999999999997e-06 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623313+0000", 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063408750000000002 2024-09-18T10:32:10.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623342+0000", 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9731999999999999e-05 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 60/33 ECSubWrite(tid=246, reqid=osd.4.0:246, at_version=60'68, trim_to=0'0, roll_forward_to=60'66))", 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.327032805000002, 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0061440729999999999, 2024-09-18T10:32:10.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617295+0000", 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617317+0000", 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1696e-05 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617330+0000", 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3634e-05 2024-09-18T10:32:10.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617337+0000", 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2859999999999996e-06 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617382+0000", 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4780000000000002e-05 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617392+0000", 2024-09-18T10:32:10.016 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0261999999999999e-05 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623413+0000", 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006020928 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623440+0000", 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7203e-05 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=290, reqid=client.4589.0:563, at_version=71'78, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.615117+0000", 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.329211839999999, 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0067141670000000001, 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615117+0000", 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615117+0000", 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615116+0000", 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615519+0000", 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000403559 2024-09-18T10:32:10.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615534+0000", 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4299e-05 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615541+0000", 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2269999999999996e-06 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615806+0000", 2024-09-18T10:32:10.020 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00026529499999999997 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615816+0000", 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0169e-05 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621802+0000", 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059857729999999998 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.021 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621831+0000", 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8779e-05 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=291, reqid=client.4589.0:564, at_version=71'79, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.617188+0000", 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.327140908000001, 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.005762128, 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617188+0000", 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617188+0000", 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617187+0000", 2024-09-18T10:32:10.023 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617413+0000", 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00022624 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617430+0000", 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7024000000000002e-05 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.024 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617437+0000", 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2960000000000001e-06 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617490+0000", 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2914999999999997e-05 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617503+0000", 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2394e-05 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622916+0000", 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054133269999999999 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622950+0000", 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4008999999999999e-05 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.026 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=292, reqid=client.4589.0:565, at_version=71'80, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.621908+0000", 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.322420151999999, 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054666009999999998, 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621908+0000", 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.027 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621908+0000", 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621907+0000", 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622019+0000", 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000111227 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622038+0000", 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9550000000000001e-05 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622046+0000", 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4939999999999997e-06 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622101+0000", 2024-09-18T10:32:10.029 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5649000000000002e-05 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622115+0000", 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4124000000000001e-05 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.627347+0000", 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052318119999999997 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.030 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.627375+0000", 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7795000000000001e-05 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=295, reqid=client.4589.0:571, at_version=71'83, trim_to=0'0, roll_forward_to=71'79))", 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.632967+0000", 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.311361824, 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059280369999999997, 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.632967+0000", 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.632967+0000", 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.632966+0000", 2024-09-18T10:32:10.032 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635251+0000", 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.002284964 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635268+0000", 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7082999999999999e-05 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.033 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635275+0000", 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8340000000000001e-06 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635327+0000", 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2040000000000003e-05 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635335+0000", 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2009999999999999e-06 2024-09-18T10:32:10.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.638862+0000", 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0035274289999999999 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.638895+0000", 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2580000000000003e-05 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 76/33 ECSubWrite(tid=356, reqid=client.4589.0:681, at_version=76'65, trim_to=0'0, roll_forward_to=76'62))", 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:00.715323+0000", 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.2290054010000002, 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065391249999999998, 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715323+0000", 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715323+0000", 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715322+0000", 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715343+0000", 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.012e-05 2024-09-18T10:32:10.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715356+0000", 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3229e-05 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715362+0000", 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8080000000000001e-06 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715414+0000", 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2711999999999999e-05 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715430+0000", 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.592e-05 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721838+0000", 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064080719999999999 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.039 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721862+0000", 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4108999999999999e-05 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.040 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:10.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:32:10.042 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:10.040+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:10.142 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:10.141+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:10.181 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:10.181 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:10.181 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:10.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:32:10.243 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:10.242+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:10.326 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:10.326 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:32:10.327 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:32:10.327 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:10.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:32:10.344 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:10.343+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:10.433 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.433 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s2 44/33 ECSubWrite(tid=113, reqid=osd.4.0:111, at_version=0'0, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.118183639000002, 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0096622919999999994, 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.434 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312540+0000", 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312552+0000", 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1926000000000001e-05 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312564+0000", 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2734e-05 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312577+0000", 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2539e-05 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312636+0000", 2024-09-18T10:32:10.436 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9327999999999998e-05 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312644+0000", 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0399999999999993e-06 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322170+0000", 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0095254759999999997 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.437 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322203+0000", 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3006000000000002e-05 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s1 44/33 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=44'37, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.312611+0000", 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.118113409000003, 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0096383990000000006, 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312611+0000", 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312611+0000", 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.439 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312610+0000", 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312634+0000", 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3377999999999999e-05 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312644+0000", 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0166000000000001e-05 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.440 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.312651+0000", 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4819999999999997e-06 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001182893 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313844+0000", 2024-09-18T10:32:10.441 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4760000000000004e-06 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322229+0000", 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0083849960000000005 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322249+0000", 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0214e-05 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.442 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s1 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.117648406999997, 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.012375268, 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313076+0000", 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313075+0000", 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313101+0000", 2024-09-18T10:32:10.444 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5962e-05 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313112+0000", 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1250000000000001e-05 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313119+0000", 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7909999999999999e-06 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.445 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314181+0000", 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001061698 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314190+0000", 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.0729999999999994e-06 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325424+0000", 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011234141 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.446 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325451+0000", 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7127e-05 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 44/33 ECSubWrite(tid=114, reqid=osd.4.0:114, at_version=44'28, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.116890245999997, 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0084741179999999992, 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.447 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313834+0000", 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313833+0000", 2024-09-18T10:32:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313855+0000", 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2441000000000001e-05 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313868+0000", 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3063e-05 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313876+0000", 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3869999999999997e-06 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313948+0000", 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313958+0000", 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5440000000000004e-06 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322284+0000", 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.008326244 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.322308+0000", 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4128999999999999e-05 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.115806775000003, 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010775300999999999, 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314917+0000", 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314987+0000", 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0817999999999999e-05 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315007+0000", 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9281000000000001e-05 2024-09-18T10:32:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315014+0000", 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7160000000000003e-06 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315107+0000", 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2695999999999995e-05 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315116+0000", 2024-09-18T10:32:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7199999999999995e-06 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325662+0000", 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010545769 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325693+0000", 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1049e-05 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.es1 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.315088+0000", 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.115636518999999, 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010384595, 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315088+0000", 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315088+0000", 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315087+0000", 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315209+0000", 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000121617 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315221+0000", 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1911e-05 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315227+0000", 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6989999999999997e-06 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315429+0000", 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000202139 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.315440+0000", 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0088000000000001e-05 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325455+0000", 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010015856 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325472+0000", 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6728e-05 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.317653+0000", 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.113070976000003, 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0078543569999999993, 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317653+0000", 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317653+0000", 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317652+0000", 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317665+0000", 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3203e-05 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317676+0000", 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1208e-05 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317692+0000", 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5367999999999999e-05 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317735+0000", 2024-09-18T10:32:10.464 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3572999999999998e-05 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317744+0000", 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7770000000000008e-06 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325490+0000", 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0077454200000000003 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.465 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325507+0000", 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7776999999999999e-05 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 44/33 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=44'28, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.318252+0000", 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.112472500000003, 2024-09-18T10:32:10.466 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.012632519, 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318252+0000", 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318252+0000", 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318251+0000", 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318269+0000", 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7972e-05 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318281+0000", 2024-09-18T10:32:10.468 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2516e-05 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318287+0000", 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3929999999999999e-06 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318339+0000", 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2361999999999998e-05 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.469 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.318344+0000", 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.417e-06 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.330858+0000", 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.012513188999999999 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.330884+0000", 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.641e-05 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.470 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.345487+0000", 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.085237161000002, 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072124850000000003, 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345487+0000", 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345487+0000", 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345486+0000", 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345597+0000", 2024-09-18T10:32:10.472 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00011134 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345610+0000", 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2444e-05 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345615+0000", 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0930000000000002e-06 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.473 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345656+0000", 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0751999999999999e-05 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345662+0000", 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.4760000000000003e-06 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352665+0000", 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070024670000000001 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352699+0000", 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4790999999999999e-05 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s2 45/33 ECSubWrite(tid=141, reqid=client.4589.0:317, at_version=45'27, trim_to=0'0, roll_forward_to=45'25))", 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.406878+0000", 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 40.023846214000002, 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0075315410000000001, 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406878+0000", 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406878+0000", 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406877+0000", 2024-09-18T10:32:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406900+0000", 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2793e-05 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406914+0000", 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4287999999999999e-05 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406921+0000", 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3270000000000003e-06 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406969+0000", 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7361999999999998e-05 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.406978+0000", 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9299999999999992e-06 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.414359+0000", 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0073809269999999998 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.414409+0000", 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0705999999999999e-05 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.479 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 50/33 ECSubWrite(tid=174, reqid=client.4589.0:370, at_version=50'42, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.599149+0000", 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 35.831575516999997, 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.007276701, 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.599149+0000", 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.480 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.599149+0000", 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.599148+0000", 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600317+0000", 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011683399999999999 2024-09-18T10:32:10.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600329+0000", 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2302e-05 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600336+0000", 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3900000000000004e-06 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600411+0000", 2024-09-18T10:32:10.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4574999999999997e-05 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.600425+0000", 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4514e-05 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606398+0000", 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059725029999999997 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606425+0000", 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7345999999999999e-05 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.cs6 60/33 ECSubWrite(tid=97, reqid=osd.5.0:97, at_version=60'45, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.827480072, 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072626629999999999, 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603244+0000", 2024-09-18T10:32:10.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603262+0000", 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8258999999999999e-05 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603269+0000", 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8000000000000001e-06 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603273+0000", 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9890000000000003e-06 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.605773+0000", 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025003830000000001 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.605779+0000", 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5520000000000004e-06 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.487 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610491+0000", 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0047124439999999997 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610507+0000", 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5532e-05 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs3 60/33 ECSubWrite(tid=134, reqid=osd.13.0:134, at_version=60'60, trim_to=0'0, roll_forward_to=56'56))", 2024-09-18T10:32:10.488 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.608918+0000", 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.821806183, 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091234469999999998, 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608918+0000", 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608918+0000", 2024-09-18T10:32:10.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608917+0000", 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608938+0000", 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0448000000000001e-05 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608949+0000", 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1253999999999999e-05 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.608955+0000", 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9800000000000003e-06 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610475+0000", 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0015199460000000001 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.491 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610485+0000", 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.9830000000000008e-06 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618006+0000", 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0075214629999999999 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618041+0000", 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5040999999999999e-05 2024-09-18T10:32:10.492 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/33 ECSubWrite(tid=242, reqid=osd.4.0:239, at_version=0'0, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.611115+0000", 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.819609495999998, 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072412639999999999, 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.493 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611115+0000", 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611115+0000", 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611114+0000", 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611124+0000", 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.9860000000000006e-06 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611132+0000", 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0469999999999994e-06 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611137+0000", 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0010000000000001e-06 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611165+0000", 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8081000000000001e-05 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.611170+0000", 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0440000000000003e-06 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618330+0000", 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0071604549999999996 2024-09-18T10:32:10.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.618356+0000", 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5313e-05 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/33 ECSubWrite(tid=243, reqid=osd.4.0:243, at_version=60'76, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.612618+0000", 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.818105945999999, 2024-09-18T10:32:10.497 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081941400000000008, 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612618+0000", 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612618+0000", 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.498 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612617+0000", 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612639+0000", 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1943e-05 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612658+0000", 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8462999999999999e-05 2024-09-18T10:32:10.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612665+0000", 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8820000000000003e-06 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612711+0000", 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6078000000000002e-05 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.612719+0000", 2024-09-18T10:32:10.500 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0790000000000001e-06 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620789+0000", 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0080698490000000005 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620812+0000", 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3549000000000001e-05 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/33 ECSubWrite(tid=244, reqid=osd.4.0:244, at_version=60'78, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.817045870000001, 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0098792110000000006, 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613678+0000", 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613701+0000", 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3716000000000001e-05 2024-09-18T10:32:10.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613711+0000", 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2979999999999997e-06 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.613716+0000", 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.84e-06 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.615644+0000", 2024-09-18T10:32:10.504 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0019279130000000001 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.615653+0000", 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.8510000000000005e-06 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623528+0000", 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0078746100000000006 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623557+0000", 2024-09-18T10:32:10.505 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9499e-05 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs3 60/33 ECSubWrite(tid=138, reqid=osd.13.0:138, at_version=60'64, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619985+0000", 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 25.810739245000001, 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0088989340000000007, 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.506 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619985+0000", 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619985+0000", 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619984+0000", 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619996+0000", 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1819e-05 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620003+0000", 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7020000000000004e-06 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620007+0000", 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2409999999999997e-06 2024-09-18T10:32:10.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.621085+0000", 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0010775489999999999 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.621095+0000", 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0723000000000001e-05 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628861+0000", 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.007765297 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628884+0000", 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3042000000000001e-05 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s4 71/33 ECSubWrite(tid=291, reqid=client.4589.0:564, at_version=71'79, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.617053+0000", 2024-09-18T10:32:10.510 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.813671225, 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0079511679999999998, 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617053+0000", 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617053+0000", 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617052+0000", 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617270+0000", 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00021799699999999999 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617285+0000", 2024-09-18T10:32:10.512 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4791e-05 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617292+0000", 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.17e-06 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.618748+0000", 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0014565139999999999 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.513 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.618757+0000", 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5490000000000006e-06 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624963+0000", 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062056990000000003 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.625004+0000", 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.1349e-05 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.514 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.cs6 75/33 ECSubWrite(tid=112, reqid=osd.5.0:112, at_version=75'56, trim_to=0'0, roll_forward_to=73'54))", 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.702234+0000", 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.72849029, 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0076836980000000001, 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702234+0000", 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702234+0000", 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702234+0000", 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702253+0000", 2024-09-18T10:32:10.516 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9332999999999999e-05 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702263+0000", 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0311e-05 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702268+0000", 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1830000000000002e-06 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.517 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702318+0000", 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9271000000000003e-05 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702327+0000", 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3470000000000005e-06 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709890+0000", 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.007563429 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.518 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709917+0000", 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6959999999999999e-05 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s1 75/33 ECSubWrite(tid=115, reqid=client.4589.0:658, at_version=75'92, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.702717+0000", 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 10.728006579000001, 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072315870000000003, 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.519 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702717+0000", 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702717+0000", 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702717+0000", 2024-09-18T10:32:10.520 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703207+0000", 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048989499999999996 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703218+0000", 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.101e-05 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.521 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703223+0000", 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8359999999999999e-06 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703273+0000", 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0923e-05 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703282+0000", 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3119999999999994e-06 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.522 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709929+0000", 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006646796 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709949+0000", 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0488000000000001e-05 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:10.523 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:10.525 DEBUG:teuthology.orchestra.run.smithi071:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal --op apply-layout-settings --pool rbd 2024-09-18T10:32:10.526 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:32:10.526 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:10.524+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:10.617 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:32:10.617 INFO:tasks.rados.rados.0.smithi160.stdout:319: done (2 left) 2024-09-18T10:32:10.617 INFO:tasks.rados.rados.0.smithi160.stdout:322: done (1 left) 2024-09-18T10:32:10.617 INFO:tasks.rados.rados.0.smithi160.stdout:323: done (0 left) 2024-09-18T10:32:10.618 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 34 current snap is 26 2024-09-18T10:32:10.618 INFO:tasks.rados.rados.0.smithi160.stdout:324: seq_num 141 ranges {0=425984,425984=573440,999424=425984,1425408=524288,1949696=425984} 2024-09-18T10:32:10.619 INFO:tasks.rados.rados.0.smithi160.stdout:324: writing smithi16036501-34 from 0 to 425984 tid 1 2024-09-18T10:32:10.622 INFO:tasks.rados.rados.0.smithi160.stdout:324: writing smithi16036501-34 from 425984 to 999424 tid 2 2024-09-18T10:32:10.625 INFO:tasks.rados.rados.0.smithi160.stdout:324: writing smithi16036501-34 from 999424 to 1425408 tid 3 2024-09-18T10:32:10.626 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:10.624+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:10.629 INFO:tasks.rados.rados.0.smithi160.stdout:324: writing smithi16036501-34 from 1425408 to 1949696 tid 4 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:324: writing smithi16036501-34 from 1949696 to 2375680 tid 5 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:325: copy_from oid 42 from oid 44 current snap is 26 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 1 to smithi16036501-34 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 2 to smithi16036501-34 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 3 to smithi16036501-34 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:326: copy_from oid 24 from oid 3 current snap is 26 2024-09-18T10:32:10.632 INFO:tasks.rados.rados.0.smithi160.stdout:327: snap_remove snap 25 2024-09-18T10:32:10.640 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:10.640 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:10.640 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:32:10.640 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:10.651 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:32:10.727 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:10.725+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:10.749 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:10.749 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:10.749 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:32:10.749 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:32:10.749 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:10.758 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:32:10.827 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:10.826+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.es5 44/33 ECSubWrite(tid=16, reqid=osd.11.0:16, at_version=44'11, trim_to=0'0, roll_forward_to=42'9))", 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.541503841000001, 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010619747000000001, 2024-09-18T10:32:10.858 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.859 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314164+0000", 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314194+0000", 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9682000000000001e-05 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314208+0000", 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4456e-05 2024-09-18T10:32:10.860 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314216+0000", 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4039999999999998e-06 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314276+0000", 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0130000000000002e-05 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314307+0000", 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.0667999999999998e-05 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324753+0000", 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010446057999999999 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324784+0000", 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1608e-05 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.862 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.2s1 44/33 ECSubWrite(tid=11, reqid=osd.14.0:11, at_version=44'10, trim_to=0'0, roll_forward_to=42'8))", 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.540788878999997, 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010009494000000001, 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.863 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314879+0000", 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314896+0000", 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7241e-05 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314908+0000", 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1807000000000001e-05 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314914+0000", 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6470000000000003e-06 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.865 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.314993+0000", 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9171999999999993e-05 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315014+0000", 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1325999999999999e-05 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324876+0000", 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.009861692 2024-09-18T10:32:10.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324889+0000", 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2867000000000001e-05 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=73, reqid=osd.13.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.540033794999999, 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0092378719999999994, 2024-09-18T10:32:10.867 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.868 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315634+0000", 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315646+0000", 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2227e-05 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.869 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315665+0000", 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9485999999999999e-05 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315676+0000", 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1144e-05 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.315894+0000", 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000217343 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.316163+0000", 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00026891000000000003 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324826+0000", 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086628130000000001 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.871 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.324872+0000", 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6819e-05 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.as4 44/33 ECSubWrite(tid=74, reqid=client.4589.0:278, at_version=44'22, trim_to=0'0, roll_forward_to=44'20))", 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.536470198000004, 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0091122809999999999, 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.872 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319198+0000", 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.873 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319197+0000", 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319499+0000", 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00030185299999999998 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319516+0000", 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7447000000000001e-05 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.874 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319524+0000", 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8560000000000007e-06 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319581+0000", 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6787999999999999e-05 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.319590+0000", 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2150000000000007e-06 2024-09-18T10:32:10.875 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328264+0000", 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0086732709999999998 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328310+0000", 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.6757e-05 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.876 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s3 44/33 ECSubWrite(tid=126, reqid=osd.6.0:126, at_version=44'9, trim_to=0'0, roll_forward_to=42'7))", 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.534740217, 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013131472, 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.877 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320928+0000", 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320927+0000", 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320950+0000", 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2860000000000001e-05 2024-09-18T10:32:10.878 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320963+0000", 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3281999999999999e-05 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.320970+0000", 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.815e-06 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321072+0000", 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000101679 2024-09-18T10:32:10.879 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.321082+0000", 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0112000000000001e-05 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334037+0000", 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.012954979 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.880 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334060+0000", 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2616000000000002e-05 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:285 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~442368] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.532648154, 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.013315863000000001, 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.881 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 285 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323020+0000", 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.882 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323018+0000", 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323786+0000", 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00076849899999999996 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.883 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323806+0000", 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9749999999999999e-05 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.323816+0000", 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.91e-06 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326375+0000", 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025593740000000001 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.884 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.326486+0000", 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000110361 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328927+0000", 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0024414390000000001 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334196+0000", 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052685989999999997 2024-09-18T10:32:10.885 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336273+0000", 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020772350000000002 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336336+0000", 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2928999999999993e-05 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.886 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:286 3.0s0 3:02ffc1f8:::smithi16036501-17:head [append 0~720896] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.526960545000001, 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0080273050000000002, 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 286 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328708+0000", 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.328706+0000", 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.888 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329422+0000", 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00071608700000000002 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329439+0000", 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6762e-05 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329444+0000", 2024-09-18T10:32:10.889 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2220000000000001e-06 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330184+0000", 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00074012100000000005 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.330295+0000", 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000111335 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.890 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.331780+0000", 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001484899 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334386+0000", 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0026057580000000001 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336669+0000", 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002283532 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.891 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.336735+0000", 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5593999999999996e-05 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:288 3.0s0 3:02ffc1f8:::smithi16036501-17:head [setxattr _header (56) in=7b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.526185204999997, 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0084205180000000001, 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.892 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 288 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:10.893 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329483+0000", 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329485+0000", 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.813e-06 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.894 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329489+0000", 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3639999999999999e-06 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329491+0000", 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1789999999999998e-06 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.334535+0000", 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050437019999999997 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.895 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335074+0000", 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00053956900000000005 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.335709+0000", 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00063488599999999998 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337448+0000", 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001738945 2024-09-18T10:32:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337849+0000", 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040134200000000001 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337904+0000", 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4129000000000003e-05 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.897 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:289 3.0s0 3:02ffc1f8:::smithi16036501-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 41.526174711000003, 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0097207330000000005, 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 289 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.898 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329494+0000", 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329493+0000", 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.899 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329495+0000", 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.376e-06 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329498+0000", 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.6380000000000002e-06 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.900 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.329501+0000", 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2670000000000001e-06 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337024+0000", 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075235809999999997 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.337080+0000", 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.5986999999999998e-05 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.901 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338204+0000", 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001123476 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.338288+0000", 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4359999999999999e-05 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:29.339214+0000", 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000926333 2024-09-18T10:32:10.902 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:415 3.0s0 3:0a6b7166:::smithi16036501-28:head [append 0~0] snapc 13=[13,11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 32.226708850000001, 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079305439999999994, 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.903 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 415 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.904 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628959+0000", 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628962+0000", 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4690000000000002e-06 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628969+0000", 2024-09-18T10:32:10.905 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9720000000000003e-06 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.628973+0000", 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9740000000000004e-06 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629040+0000", 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6503999999999999e-05 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:10.906 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.629043+0000", 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.1329999999999999e-06 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633315+0000", 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042715519999999996 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633399+0000", 2024-09-18T10:32:10.907 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4252999999999994e-05 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.633789+0000", 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00039028199999999999 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636113+0000", 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.002324062 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636794+0000", 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00068055999999999998 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:38.636890+0000", 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6304999999999994e-05 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:422 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~737280] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:32:10.909 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.20574804, 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.010997704000000001, 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 422 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:32:10.910 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649920+0000", 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.649918+0000", 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.911 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650522+0000", 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00060473000000000005 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650543+0000", 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0928999999999999e-05 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650551+0000", 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9699999999999999e-06 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650611+0000", 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0090000000000002e-05 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op must wait for map", 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.650621+0000", 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6739999999999992e-06 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.652641+0000", 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0020202430000000001 2024-09-18T10:32:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.652748+0000", 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000106977 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.654248+0000", 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001500028 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660764+0000", 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.006516127 2024-09-18T10:32:10.914 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660831+0000", 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.6540999999999999e-05 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660918+0000", 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6994000000000001e-05 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.915 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:423 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~573440] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.202504199, 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0093190359999999993, 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 423 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.916 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653164+0000", 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653163+0000", 2024-09-18T10:32:10.917 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653853+0000", 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00069050600000000002 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653868+0000", 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.524e-05 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.653879+0000", 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0584999999999999e-05 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.656943+0000", 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003063985 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657047+0000", 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103649 2024-09-18T10:32:10.919 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.657886+0000", 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00083983699999999996 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661372+0000", 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034854690000000002 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.920 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662421+0000", 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001048736 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662483+0000", 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2453999999999995e-05 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:424 3.0s0 3:0d48e6bb:::smithi16036501-38:head [append 0~196608] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:10.921 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.200658459, 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096355950000000003, 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 424 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:32:10.922 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655010+0000", 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655009+0000", 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655125+0000", 2024-09-18T10:32:10.923 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000116648 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655139+0000", 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3869000000000001e-05 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655146+0000", 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0360000000000001e-06 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658784+0000", 2024-09-18T10:32:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036375840000000001 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.658889+0000", 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00010497600000000001 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.659461+0000", 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00057189199999999995 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.925 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661374+0000", 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001913849 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664576+0000", 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003202004 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664645+0000", 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9060999999999995e-05 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.926 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:425 3.0s0 3:0d48e6bb:::smithi16036501-38:head [setxattr _header (57) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.200514930000001, 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096364109999999992, 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 425 2024-09-18T10:32:10.927 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.928 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655153+0000", 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655156+0000", 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5190000000000001e-06 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655163+0000", 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.3759999999999996e-06 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.929 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655167+0000", 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9400000000000004e-06 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.659827+0000", 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046608539999999999 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660123+0000", 2024-09-18T10:32:10.930 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00029602200000000001 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.660525+0000", 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00040106499999999998 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.662166+0000", 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.001641595 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664727+0000", 2024-09-18T10:32:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0025612529999999999 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.664790+0000", 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2372000000000005e-05 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4589.0:426 3.0s0 3:0d48e6bb:::smithi16036501-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:32:10.932 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.200497636000001, 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.011075404, 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "started", 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4589", 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 426 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.933 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655171+0000", 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655170+0000", 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.934 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655178+0000", 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8469999999999996e-06 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655185+0000", 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7510000000000002e-06 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.655189+0000", 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9570000000000004e-06 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.935 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661136+0000", 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0059469930000000002 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.661287+0000", 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00015076999999999999 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.665373+0000", 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0040862720000000002 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.665456+0000", 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2935000000000005e-05 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.666246+0000", 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00079023899999999998 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.937 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 72/33 ECSubWrite(tid=180, reqid=osd.13.0:180, at_version=72'89, trim_to=0'0, roll_forward_to=71'85))", 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.682261+0000", 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.173407395, 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0090984340000000007, 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682261+0000", 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682261+0000", 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682260+0000", 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682299+0000", 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9246000000000003e-05 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.939 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682310+0000", 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0407999999999999e-05 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682316+0000", 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.6289999999999998e-06 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682356+0000", 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0219999999999998e-05 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.940 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.682365+0000", 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.7110000000000007e-06 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691333+0000", 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0089679970000000001 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691359+0000", 2024-09-18T10:32:10.941 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5879000000000001e-05 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s5 72/33 ECSubWrite(tid=314, reqid=osd.4.0:314, at_version=72'56, trim_to=0'0, roll_forward_to=71'54))", 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.169155460000001, 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.008363021, 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.942 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686513+0000", 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.943 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686536+0000", 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3281e-05 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686545+0000", 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.1870000000000003e-06 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686550+0000", 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4940000000000003e-06 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.944 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686714+0000", 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000163246 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.686727+0000", 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2813000000000001e-05 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694852+0000", 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0081255919999999992 2024-09-18T10:32:10.945 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694876+0000", 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3723999999999999e-05 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 75/33 ECSubWrite(tid=198, reqid=osd.13.0:198, at_version=75'99, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.147541378, 2024-09-18T10:32:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0090926070000000008, 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.947 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708127+0000", 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708140+0000", 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3557000000000001e-05 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708150+0000", 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.5179999999999993e-06 2024-09-18T10:32:10.948 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708162+0000", 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1956e-05 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708280+0000", 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000118056 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.949 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.708290+0000", 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.9199999999999999e-06 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717185+0000", 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0088948619999999999 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717220+0000", 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.4869000000000001e-05 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.950 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.fs1 75/33 ECSubWrite(tid=199, reqid=osd.13.0:199, at_version=75'101, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.146473693000001, 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0085760149999999993, 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.951 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709194+0000", 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709214+0000", 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0176000000000001e-05 2024-09-18T10:32:10.952 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709225+0000", 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1260999999999999e-05 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709232+0000", 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.263e-06 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709775+0000", 2024-09-18T10:32:10.953 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00054309200000000001 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.709784+0000", 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.2660000000000007e-06 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717744+0000", 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0079602270000000003 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.954 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717771+0000", 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.6372000000000001e-05 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s5 75/33 ECSubWrite(tid=345, reqid=osd.4.0:345, at_version=75'60, trim_to=0'0, roll_forward_to=73'58))", 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710127+0000", 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.145541724999999, 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0076564620000000002, 2024-09-18T10:32:10.955 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710127+0000", 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710127+0000", 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.956 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710126+0000", 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710145+0000", 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9440999999999999e-05 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710158+0000", 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2308e-05 2024-09-18T10:32:10.957 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710164+0000", 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.9900000000000002e-06 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710209+0000", 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5089999999999997e-05 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710219+0000", 2024-09-18T10:32:10.958 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0131e-05 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717760+0000", 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0075410290000000003 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717783+0000", 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.3195000000000001e-05 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:10.959 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:10.960 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:10.961 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:32:10.961 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:10.960+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:11.061 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:11.060+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:11.101 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:11.101 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:11.101 INFO:teuthology.orchestra.run.smithi160.stdout: "num_ops": 0 2024-09-18T10:32:11.101 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:11.109 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:32:11.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:32:11.193 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:11.192+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:11.246 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:11.246 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [], 2024-09-18T10:32:11.247 INFO:teuthology.orchestra.run.smithi160.stdout: "complaint_time": 30, 2024-09-18T10:32:11.247 INFO:teuthology.orchestra.run.smithi160.stdout: "num_blocked_ops": 0 2024-09-18T10:32:11.247 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:11.255 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:32:11.264 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:11.263+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:11.301 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:11.301 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:11.318 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:11.318 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:11.334 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:11.350 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:11.350 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:11.365 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:11.365 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:11.364+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:11.380 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:11.396 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-18T10:32:11.396 INFO:teuthology.orchestra.run.smithi160.stdout: "size": 20, 2024-09-18T10:32:11.396 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 600, 2024-09-18T10:32:11.396 INFO:teuthology.orchestra.run.smithi160.stdout: "ops": [ 2024-09-18T10:32:11.396 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.396 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 49/33 ECSubWrite(tid=41, reqid=osd.3.0:40, at_version=0'0, trim_to=0'0, roll_forward_to=49'29))", 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.789579195999998, 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0056101689999999999, 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.397 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604032+0000", 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.398 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604042+0000", 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0319999999999999e-05 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604052+0000", 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6830000000000003e-06 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604058+0000", 2024-09-18T10:32:11.399 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.2500000000000003e-06 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604104+0000", 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.5391e-05 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.400 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604112+0000", 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.6780000000000006e-06 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609618+0000", 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055057309999999998 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609643+0000", 2024-09-18T10:32:11.401 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4572000000000001e-05 2024-09-18T10:32:11.403 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.403 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 49/33 ECSubWrite(tid=169, reqid=osd.4.0:168, at_version=0'0, trim_to=0'0, roll_forward_to=49'32))", 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.789175264000001, 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051417169999999996, 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.404 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604436+0000", 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604435+0000", 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.405 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604448+0000", 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2131e-05 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604459+0000", 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1649e-05 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604466+0000", 2024-09-18T10:32:11.406 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4799999999999998e-06 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604513+0000", 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7036999999999997e-05 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604523+0000", 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0118999999999999e-05 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.407 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609552+0000", 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050292749999999997 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.609578+0000", 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5811000000000001e-05 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=31, reqid=osd.8.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:32:11.408 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.789041124000001, 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0055933889999999998, 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604570+0000", 2024-09-18T10:32:11.409 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604569+0000", 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604584+0000", 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5183e-05 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.410 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604599+0000", 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4738e-05 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604606+0000", 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8390000000000001e-06 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604658+0000", 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.2009000000000003e-05 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.411 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.604667+0000", 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.4269999999999997e-06 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610148+0000", 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054800889999999996 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.610164+0000", 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6271999999999999e-05 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.412 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.786781302999998, 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0054572869999999999, 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:32:11.413 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606830+0000", 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606829+0000", 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.414 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606859+0000", 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.9223000000000001e-05 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606874+0000", 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606880+0000", 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5400000000000001e-06 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.415 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606942+0000", 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.1527999999999998e-05 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.606952+0000", 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0139999999999999e-05 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612246+0000", 2024-09-18T10:32:11.416 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0052944999999999997 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612288+0000", 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1016000000000002e-05 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 49/33 ECSubWrite(tid=32, reqid=client.4589.0:367, at_version=49'24, trim_to=0'0, roll_forward_to=49'22))", 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:11.417 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 37.786110133999998, 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051511930000000001, 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.418 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607501+0000", 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607667+0000", 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000166269 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.419 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607677+0000", 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.397e-06 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607681+0000", 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.2139999999999998e-06 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607714+0000", 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3355999999999997e-05 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.420 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.607723+0000", 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.9719999999999998e-06 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612630+0000", 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0049068009999999997 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:33.612653+0000", 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2731999999999999e-05 2024-09-18T10:32:11.421 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 55/33 ECSubWrite(tid=77, reqid=client.4589.0:450, at_version=55'32, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 31.613019885, 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0046866, 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.422 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.780592+0000", 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.423 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781300+0000", 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00070876399999999997 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781311+0000", 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0360000000000001e-05 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781316+0000", 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.0529999999999997e-06 2024-09-18T10:32:11.424 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781356+0000", 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9888000000000002e-05 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.781362+0000", 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.8820000000000003e-06 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.785253+0000", 2024-09-18T10:32:11.425 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0038900670000000001 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:39.785278+0000", 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.5712e-05 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 56/33 ECSubWrite(tid=63, reqid=osd.3.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=56'51))", 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 30.753263477000001, 2024-09-18T10:32:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042165529999999996, 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640348+0000", 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640347+0000", 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1082e-05 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640372+0000", 2024-09-18T10:32:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3559e-05 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640378+0000", 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5209999999999999e-06 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640427+0000", 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.8717999999999997e-05 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.640438+0000", 2024-09-18T10:32:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0793e-05 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.644544+0000", 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0041064129999999997 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:40.644565+0000", 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0265999999999999e-05 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.430 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 60/33 ECSubWrite(tid=74, reqid=osd.3.0:73, at_version=0'0, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 26.780596897999999, 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0051941000000000001, 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.431 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613015+0000", 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613014+0000", 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613026+0000", 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2536e-05 2024-09-18T10:32:11.432 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613041+0000", 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4487999999999999e-05 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613065+0000", 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4145e-05 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.433 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613135+0000", 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.0297999999999997e-05 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613145+0000", 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0288999999999999e-05 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618182+0000", 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0050361340000000003 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.434 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618209+0000", 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.7146000000000001e-05 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 60/33 ECSubWrite(tid=75, reqid=osd.3.0:75, at_version=60'64, trim_to=0'0, roll_forward_to=60'62))", 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 26.779760478, 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0043719620000000001, 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.435 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613851+0000", 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613850+0000", 2024-09-18T10:32:11.436 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613869+0000", 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9038999999999998e-05 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613882+0000", 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2539e-05 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.437 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613888+0000", 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.806e-06 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613928+0000", 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0584000000000003e-05 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.613936+0000", 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9219999999999997e-06 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.438 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618212+0000", 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042758199999999996 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:44.618223+0000", 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1009000000000001e-05 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 71/33 ECSubWrite(tid=299, reqid=client.4589.0:576, at_version=71'52, trim_to=0'0, roll_forward_to=69'49))", 2024-09-18T10:32:11.439 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:55.654955+0000", 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 15.738656311, 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042654620000000002, 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.654955+0000", 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.654955+0000", 2024-09-18T10:32:11.440 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.654954+0000", 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655481+0000", 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00052745099999999996 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.441 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655496+0000", 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4426e-05 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655504+0000", 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9370000000000004e-06 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655557+0000", 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3276000000000003e-05 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.442 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.655569+0000", 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1773999999999999e-05 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.659199+0000", 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036300949999999998 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:55.659221+0000", 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1736999999999999e-05 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.443 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 72/33 ECSubWrite(tid=90, reqid=osd.3.0:90, at_version=72'76, trim_to=0'0, roll_forward_to=71'74))", 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.71217916, 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0098813010000000003, 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.444 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681432+0000", 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.445 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681546+0000", 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000113816 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681559+0000", 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3448999999999999e-05 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681567+0000", 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.7209999999999994e-06 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.446 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681664+0000", 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6910000000000006e-05 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.681675+0000", 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1195999999999999e-05 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691281+0000", 2024-09-18T10:32:11.447 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096056779999999994 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.691314+0000", 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.2826e-05 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 72/33 ECSubWrite(tid=314, reqid=osd.4.0:314, at_version=72'56, trim_to=0'0, roll_forward_to=71'54))", 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.708885112000001, 2024-09-18T10:32:11.448 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0094518429999999997, 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.449 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684726+0000", 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684742+0000", 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.6058000000000001e-05 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684754+0000", 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1542000000000001e-05 2024-09-18T10:32:11.450 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684761+0000", 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.3000000000000004e-06 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684836+0000", 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4505999999999994e-05 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.451 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.684858+0000", 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.2286e-05 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694149+0000", 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0092913449999999995 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:56.694178+0000", 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.8975e-05 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.452 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.0s1 75/33 ECSubWrite(tid=99, reqid=osd.3.0:99, at_version=75'82, trim_to=0'0, roll_forward_to=73'80))", 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.707719+0000", 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.685892932, 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0096391459999999995, 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707719+0000", 2024-09-18T10:32:11.453 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707719+0000", 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707718+0000", 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.454 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707736+0000", 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.8108999999999999e-05 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707747+0000", 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0796e-05 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707756+0000", 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.4330000000000004e-06 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.455 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707803+0000", 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7726999999999999e-05 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.707814+0000", 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0535e-05 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717317+0000", 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0095034339999999998 2024-09-18T10:32:11.456 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717358+0000", 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.0374999999999999e-05 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.1s4 75/33 ECSubWrite(tid=345, reqid=osd.4.0:345, at_version=75'60, trim_to=0'0, roll_forward_to=73'58))", 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:11.457 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.683522157000001, 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0078501869999999998, 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.458 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710089+0000", 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967296 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710107+0000", 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.772e-05 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710115+0000", 2024-09-18T10:32:11.459 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.9270000000000005e-06 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710119+0000", 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.301e-06 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710162+0000", 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3102999999999997e-05 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710175+0000", 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2765000000000001e-05 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717919+0000", 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0077437189999999996 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717940+0000", 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.0812e-05 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.461 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 75/33 ECSubWrite(tid=113, reqid=osd.5.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=75'56))", 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.710325+0000", 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.68328674, 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070424759999999998, 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710325+0000", 2024-09-18T10:32:11.462 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710325+0000", 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710324+0000", 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.463 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710335+0000", 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0583e-05 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710349+0000", 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4076999999999999e-05 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710355+0000", 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.0079999999999999e-06 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.464 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710409+0000", 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.3871e-05 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.710422+0000", 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3739e-05 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717350+0000", 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0069278009999999999 2024-09-18T10:32:11.465 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717367+0000", 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.7127999999999999e-05 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.4s6 75/33 ECSubWrite(tid=71, reqid=osd.8.0:70, at_version=0'0, trim_to=0'0, roll_forward_to=75'61))", 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.713760+0000", 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.679851669, 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042101150000000004, 2024-09-18T10:32:11.466 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713760+0000", 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713760+0000", 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.467 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713759+0000", 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713769+0000", 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0199e-05 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713781+0000", 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2334000000000001e-05 2024-09-18T10:32:11.468 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713787+0000", 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.4929999999999998e-06 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713820+0000", 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.3549e-05 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.713827+0000", 2024-09-18T10:32:11.469 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.5810000000000002e-06 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717948+0000", 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004121268 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.717970+0000", 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1795000000000001e-05 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.470 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.cs4 75/33 ECSubWrite(tid=114, reqid=client.4589.0:663, at_version=75'58, trim_to=0'0, roll_forward_to=75'56))", 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:31:59.731399+0000", 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 11.66221236, 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.004059455, 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731399+0000", 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.471 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731399+0000", 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731398+0000", 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731897+0000", 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00049827400000000005 2024-09-18T10:32:11.472 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731908+0000", 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.1831000000000001e-05 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731913+0000", 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.7149999999999997e-06 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731951+0000", 2024-09-18T10:32:11.473 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7755e-05 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.731958+0000", 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.7120000000000003e-06 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.735437+0000", 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0034797740000000001 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.474 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:31:59.735459+0000", 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1208000000000001e-05 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s6 82/33 ECSubWrite(tid=131, reqid=client.4589.0:719, at_version=82'13, trim_to=0'0, roll_forward_to=64'11))", 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:32:06.621269+0000", 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.7723425710000003, 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0044140630000000002, 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.475 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621269+0000", 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621269+0000", 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621268+0000", 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.476 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621822+0000", 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00055420199999999995 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621838+0000", 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5863e-05 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621853+0000", 2024-09-18T10:32:11.477 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4756999999999999e-05 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621895+0000", 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.1724000000000002e-05 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.621904+0000", 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3870000000000001e-06 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.478 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.625643+0000", 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003738908 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.625683+0000", 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9944000000000002e-05 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s6 82/33 ECSubWrite(tid=133, reqid=client.4589.0:721, at_version=82'15, trim_to=0'0, roll_forward_to=82'13))", 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:32:06.627315+0000", 2024-09-18T10:32:11.479 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.7662968799999996, 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0042031359999999997, 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627315+0000", 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627315+0000", 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.480 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627314+0000", 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627787+0000", 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00047329799999999998 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627802+0000", 2024-09-18T10:32:11.481 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.4508000000000001e-05 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627808+0000", 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4919999999999998e-06 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627868+0000", 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 5.9805000000000001e-05 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.482 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.627878+0000", 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0079e-05 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.631496+0000", 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0036181020000000002 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.483 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.631518+0000", 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.1624000000000002e-05 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDECSubOpWrite(3.8s6 82/33 ECSubWrite(tid=134, reqid=client.4589.0:722, at_version=82'16, trim_to=0'0, roll_forward_to=82'13))", 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2024-09-18T10:32:06.628462+0000", 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 4.7651496760000001, 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0058636720000000003, 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "reached pg", 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ 2024-09-18T10:32:11.484 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628462+0000", 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628462+0000", 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628461+0000", 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 2024-09-18T10:32:11.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628481+0000", 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9663000000000001e-05 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628500+0000", 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.9018e-05 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628506+0000", 2024-09-18T10:32:11.486 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.4980000000000003e-06 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628576+0000", 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 6.9843000000000002e-05 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_started", 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.628586+0000", 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.3989999999999993e-06 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "sub_op_committed", 2024-09-18T10:32:11.487 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.634302+0000", 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0057159940000000003 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: { 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2024-09-18T10:32:06.634326+0000", 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4008000000000001e-05 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-09-18T10:32:11.488 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-18T10:32:11.489 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:11.490 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:11.490 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:11.491 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:11.491 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:32:11.491 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:11.488+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:11.492 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:11.492 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:11.492 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:11.493 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:11.493 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:11.493 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:11.493 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:11.494 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:11.494 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:11.494 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:11.494 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:11.505 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:11.506 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:11.521 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:11.521 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:11.524 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:11.525 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:11.591 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:11.590+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:11.623 INFO:tasks.rados.rados.0.smithi160.stdout:327: done (3 left) 2024-09-18T10:32:11.623 INFO:tasks.rados.rados.0.smithi160.stdout:328: read oid 31 snap -1 2024-09-18T10:32:11.623 INFO:tasks.rados.rados.0.smithi160.stdout:328: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:32:11.623 INFO:tasks.rados.rados.0.smithi160.stdout:329: read oid 39 snap -1 2024-09-18T10:32:11.623 INFO:tasks.rados.rados.0.smithi160.stdout:329: expect (ObjNum 111 snap 18 seq_num 111) 2024-09-18T10:32:11.623 INFO:tasks.rados.rados.0.smithi160.stdout:330: snap_remove snap 23 2024-09-18T10:32:11.631 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:11.632 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:11.641 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:32:11.663 INFO:teuthology.orchestra.run.smithi071.stderr:Nothing to do for non-filestore backend 2024-09-18T10:32:11.692 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:11.691+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:11.739 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:11.739 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:11.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:32:11.793 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:11.792+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:11.887 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:11.888 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:11.894 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:11.893+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:11.896 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:32:11.995 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:11.994+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:11.995 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:11.995 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.004 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:32:12.095 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:12.095+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:12.101 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.102 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.110 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:32:12.182 DEBUG:teuthology.orchestra.run.smithi071:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-9 --journal-path /var/lib/ceph/osd/ceph-9/journal --op apply-layout-settings --pool unique_pool_0 2024-09-18T10:32:12.196 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:12.195+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:12.209 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.209 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:32:12.297 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:12.296+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:12.321 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.322 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:32:12.398 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:12.397+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:12.432 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.432 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:32:12.499 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:12.498+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.542 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.551 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:32:12.600 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:12.599+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:12.622 INFO:tasks.rados.rados.0.smithi160.stdout:330: done (5 left) 2024-09-18T10:32:12.622 INFO:tasks.rados.rados.0.smithi160.stdout:331: rollback oid 36 current snap is 26 2024-09-18T10:32:12.622 INFO:tasks.rados.rados.0.smithi160.stdout:331: done (5 left) 2024-09-18T10:32:12.622 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 19 current snap is 26 2024-09-18T10:32:12.622 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 4 to smithi16036501-34 2024-09-18T10:32:12.623 INFO:tasks.rados.rados.0.smithi160.stdout:332: seq_num 142 ranges {6094848=442368,6537216=720896,7258112=540672,7798784=688128} 2024-09-18T10:32:12.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:32:12.658 INFO:tasks.rados.rados.0.smithi160.stdout:332: writing smithi16036501-19 from 6094848 to 6537216 tid 1 2024-09-18T10:32:12.660 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.660 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.662 INFO:tasks.rados.rados.0.smithi160.stdout:332: writing smithi16036501-19 from 6537216 to 7258112 tid 2 2024-09-18T10:32:12.665 INFO:tasks.rados.rados.0.smithi160.stdout:332: writing smithi16036501-19 from 7258112 to 7798784 tid 3 2024-09-18T10:32:12.669 INFO:tasks.rados.rados.0.smithi160.stdout:332: writing smithi16036501-19 from 7798784 to 8486912 tid 4 2024-09-18T10:32:12.669 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 8 current snap is 26 2024-09-18T10:32:12.669 INFO:tasks.rados.rados.0.smithi160.stdout:326: finishing copy_from to smithi16036501-24 2024-09-18T10:32:12.669 INFO:tasks.rados.rados.0.smithi160.stdout:326: got expected ENOENT (src dne) 2024-09-18T10:32:12.670 INFO:tasks.rados.rados.0.smithi160.stdout:326: finishing copy_from racing read to smithi16036501-24 2024-09-18T10:32:12.670 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 5 to smithi16036501-34 2024-09-18T10:32:12.670 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 6 to smithi16036501-34 2024-09-18T10:32:12.670 INFO:tasks.rados.rados.0.smithi160.stdout:333: seq_num 143 ranges {131072=458752,589824=475136,1064960=655360,1720320=671744,2392064=147456} 2024-09-18T10:32:12.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:32:12.672 INFO:tasks.rados.rados.0.smithi160.stdout:333: writing smithi16036501-8 from 131072 to 589824 tid 1 2024-09-18T10:32:12.675 INFO:tasks.rados.rados.0.smithi160.stdout:333: writing smithi16036501-8 from 589824 to 1064960 tid 2 2024-09-18T10:32:12.679 INFO:tasks.rados.rados.0.smithi160.stdout:333: writing smithi16036501-8 from 1064960 to 1720320 tid 3 2024-09-18T10:32:12.682 INFO:tasks.rados.rados.0.smithi160.stdout:333: writing smithi16036501-8 from 1720320 to 2392064 tid 4 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:333: writing smithi16036501-8 from 2392064 to 2539520 tid 5 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:324: finishing write tid 7 to smithi16036501-34 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 34 v 44 (ObjNum 141 snap 26 seq_num 141) dirty exists 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:324: left oid 34 (ObjNum 141 snap 26 seq_num 141) 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:325: finishing copy_from racing read to smithi16036501-42 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:325: finishing copy_from to smithi16036501-42 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 42 v 15 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-18T10:32:12.684 INFO:tasks.rados.rados.0.smithi160.stdout:328: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-18T10:32:12.697 INFO:tasks.rados.rados.0.smithi160.stdout:329: expect (ObjNum 111 snap 18 seq_num 111) 2024-09-18T10:32:12.701 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:12.699+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:12.771 INFO:tasks.rados.rados.0.smithi160.stdout:332: finishing write tid 1 to smithi16036501-19 2024-09-18T10:32:12.771 INFO:tasks.rados.rados.0.smithi160.stdout:332: finishing write tid 2 to smithi16036501-19 2024-09-18T10:32:12.771 INFO:tasks.rados.rados.0.smithi160.stdout:332: finishing write tid 3 to smithi16036501-19 2024-09-18T10:32:12.771 INFO:tasks.rados.rados.0.smithi160.stdout:332: finishing write tid 4 to smithi16036501-19 2024-09-18T10:32:12.771 INFO:tasks.rados.rados.0.smithi160.stdout:332: finishing write tid 5 to smithi16036501-19 2024-09-18T10:32:12.771 INFO:tasks.rados.rados.0.smithi160.stdout:332: finishing write tid 6 to smithi16036501-19 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 76 (ObjNum 142 snap 26 seq_num 142) dirty exists 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:332: left oid 19 (ObjNum 142 snap 26 seq_num 142) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 1 to smithi16036501-8 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 2 to smithi16036501-8 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:324: done (6 left) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:325: done (5 left) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:326: done (4 left) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:328: done (3 left) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:329: done (2 left) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:332: done (1 left) 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 23 current snap is 26 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 3 to smithi16036501-8 2024-09-18T10:32:12.772 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 4 to smithi16036501-8 2024-09-18T10:32:12.773 INFO:tasks.rados.rados.0.smithi160.stdout:334: seq_num 144 ranges {835584=16384} 2024-09-18T10:32:12.775 INFO:tasks.rados.rados.0.smithi160.stdout:334: writing smithi16036501-23 from 835584 to 851968 tid 1 2024-09-18T10:32:12.775 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 5 current snap is 26 2024-09-18T10:32:12.775 INFO:tasks.rados.rados.0.smithi160.stdout:335: seq_num 145 ranges {1982464=32768} 2024-09-18T10:32:12.787 INFO:tasks.rados.rados.0.smithi160.stdout:335: writing smithi16036501-5 from 1982464 to 2015232 tid 1 2024-09-18T10:32:12.787 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 30 current snap is 26 2024-09-18T10:32:12.787 INFO:tasks.rados.rados.0.smithi160.stdout:336: seq_num 146 ranges {491520=49152} 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:336: writing smithi16036501-30 from 491520 to 540672 tid 1 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 46 current snap is 26 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 5 to smithi16036501-8 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 6 to smithi16036501-8 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:333: finishing write tid 7 to smithi16036501-8 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 8 v 109 (ObjNum 143 snap 26 seq_num 143) dirty exists 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:333: left oid 8 (ObjNum 143 snap 26 seq_num 143) 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:334: finishing write tid 1 to smithi16036501-23 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:334: finishing write tid 2 to smithi16036501-23 2024-09-18T10:32:12.790 INFO:tasks.rados.rados.0.smithi160.stdout:337: seq_num 147 ranges {2097152=65536} 2024-09-18T10:32:12.802 INFO:tasks.rados.rados.0.smithi160.stdout:337: writing smithi16036501-46 from 2097152 to 2162688 tid 1 2024-09-18T10:32:12.802 INFO:tasks.rados.rados.0.smithi160.stdout:333: done (4 left) 2024-09-18T10:32:12.802 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 43 current snap is 26 2024-09-18T10:32:12.802 INFO:tasks.rados.rados.0.smithi160.stdout:338: seq_num 148 ranges {573440=81920} 2024-09-18T10:32:12.803 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:12.801+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:12.805 INFO:tasks.rados.rados.0.smithi160.stdout:338: writing smithi16036501-43 from 573440 to 655360 tid 1 2024-09-18T10:32:12.805 INFO:tasks.rados.rados.0.smithi160.stdout:339: snap_create 2024-09-18T10:32:12.805 INFO:tasks.rados.rados.0.smithi160.stdout:334: finishing write tid 3 to smithi16036501-23 2024-09-18T10:32:12.805 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 23 v 104 (ObjNum 144 snap 26 seq_num 144) dirty exists 2024-09-18T10:32:12.805 INFO:tasks.rados.rados.0.smithi160.stdout:334: left oid 23 (ObjNum 144 snap 26 seq_num 144) 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:335: finishing write tid 1 to smithi16036501-5 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:335: finishing write tid 2 to smithi16036501-5 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:336: finishing write tid 1 to smithi16036501-30 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:336: finishing write tid 2 to smithi16036501-30 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:335: finishing write tid 3 to smithi16036501-5 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 5 v 64 (ObjNum 145 snap 26 seq_num 145) dirty exists 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:335: left oid 5 (ObjNum 145 snap 26 seq_num 145) 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:336: finishing write tid 3 to smithi16036501-30 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 30 v 46 (ObjNum 146 snap 26 seq_num 146) dirty exists 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:336: left oid 30 (ObjNum 146 snap 26 seq_num 146) 2024-09-18T10:32:12.806 INFO:tasks.rados.rados.0.smithi160.stdout:337: finishing write tid 1 to smithi16036501-46 2024-09-18T10:32:12.807 INFO:tasks.rados.rados.0.smithi160.stdout:337: finishing write tid 2 to smithi16036501-46 2024-09-18T10:32:12.808 INFO:tasks.rados.rados.0.smithi160.stdout:337: finishing write tid 3 to smithi16036501-46 2024-09-18T10:32:12.808 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 46 v 68 (ObjNum 147 snap 26 seq_num 147) dirty exists 2024-09-18T10:32:12.808 INFO:tasks.rados.rados.0.smithi160.stdout:337: left oid 46 (ObjNum 147 snap 26 seq_num 147) 2024-09-18T10:32:12.809 INFO:tasks.rados.rados.0.smithi160.stdout:338: finishing write tid 1 to smithi16036501-43 2024-09-18T10:32:12.809 INFO:tasks.rados.rados.0.smithi160.stdout:338: finishing write tid 2 to smithi16036501-43 2024-09-18T10:32:12.811 INFO:tasks.rados.rados.0.smithi160.stdout:338: finishing write tid 3 to smithi16036501-43 2024-09-18T10:32:12.811 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 43 v 111 (ObjNum 148 snap 26 seq_num 148) dirty exists 2024-09-18T10:32:12.811 INFO:tasks.rados.rados.0.smithi160.stdout:338: left oid 43 (ObjNum 148 snap 26 seq_num 148) 2024-09-18T10:32:12.824 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.824 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:32:12.903 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:12.902+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:12.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:32:13.005 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:13.003+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:13.046 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:13.046 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:13.054 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:32:13.105 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:13.104+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:13.155 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:13.156 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:13.164 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:32:13.206 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:13.205+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:13.265 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:13.265 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:13.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:32:13.306 INFO:teuthology.orchestra.run.smithi071.stderr:Nothing to do for non-filestore backend 2024-09-18T10:32:13.317 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:13.316+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:13.376 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:13.376 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:13.384 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:32:13.408 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:13.407+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:13.508 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:13.507+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:13.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:32:13.526 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:13.526 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:13.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:32:13.609 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:13.607+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:13.629 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:334: done (5 left) 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:335: done (4 left) 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:336: done (3 left) 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:337: done (2 left) 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:338: done (1 left) 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:339: done (0 left) 2024-09-18T10:32:13.632 INFO:tasks.rados.rados.0.smithi160.stdout:340: snap_create 2024-09-18T10:32:13.648 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:13.649 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:13.680 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:13.691 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:13.691 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:13.697 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:13.697 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:13.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:32:13.710 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:13.709+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:13.713 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:13.713 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:13.728 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:13.728 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:13.744 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:13.744 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:13.760 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:13.761 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:13.777 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:13.791 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:13.792 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:13.792 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:13.798 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:13.798 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:13.798 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:13.798 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:13.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:32:13.808 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:13.808 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:13.811 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:13.809+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:13.824 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:13.828 INFO:tasks.thrashosds.thrasher:checking if target objectstore is bluestore on osd.9 2024-09-18T10:32:13.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-9 show-label 2024-09-18T10:32:13.839 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:13.839 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:13.855 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:13.855 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:13.871 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:13.871 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:13.887 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:13.887 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:13.890 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:13.891 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:13.904 INFO:teuthology.orchestra.run.smithi071.stdout:inferring bluefs devices from bluestore path 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "/var/lib/ceph/osd/ceph-9/block": { 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_uuid": "bdca945d-8cfe-4bea-a7a6-10116f45f750", 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 96636764160, 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "btime": "2024-09-18T10:30:03.844756+0000", 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "main", 2024-09-18T10:32:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "bfm_blocks": "23592960", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "bfm_blocks_per_key": "128", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "bfm_bytes_per_block": "4096", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "bfm_size": "96636764160", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs": "1", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_fsid": "f10241a9-9f2d-4ca9-8e5f-6c8b84917f59", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version_when_created": "ceph version 17.2.7-1645-g7061ea6c (7061ea6ca50908d104e9f3979dc615e118d9e153) quincy (stable)", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "created_at": "2024-09-18T10:30:06.185508Z", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "kv_backend": "rocksdb", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "magic": "ceph osd volume v026", 2024-09-18T10:32:13.906 INFO:teuthology.orchestra.run.smithi071.stdout: "mkfs_done": "yes", 2024-09-18T10:32:13.907 INFO:teuthology.orchestra.run.smithi071.stdout: "ready": "ready", 2024-09-18T10:32:13.907 INFO:teuthology.orchestra.run.smithi071.stdout: "require_osd_release": "17", 2024-09-18T10:32:13.907 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": "9" 2024-09-18T10:32:13.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:13.907 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:13.908 INFO:tasks.thrashosds.thrasher:checking if target bluestore supports sharding on osd.9 2024-09-18T10:32:13.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-9 show-sharding 2024-09-18T10:32:13.908 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:13.908 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:13.908 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:13.909 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:13.909 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:13.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:32:13.917 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:13.915+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:14.013 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:14.012+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=7, reqid=osd.14.0:7, at_version=40'6, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.763067036999999, 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024793150000000002, 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293784+0000", 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293834+0000", 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9882000000000001e-05 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293848+0000", 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3913e-05 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293857+0000", 2024-09-18T10:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293910+0000", 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2933999999999998e-05 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293919+0000", 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3440000000000007e-06 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296229+0000", 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023091040000000002 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296264+0000", 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5673999999999998e-05 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 40/33 ECSubWrite(tid=65, reqid=osd.13.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=40'15))", 2024-09-18T10:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.758281725000003, 2024-09-18T10:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004430000000002, 2024-09-18T10:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298569+0000", 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298587+0000", 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7978999999999998e-05 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298607+0000", 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9627e-05 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298628+0000", 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1246e-05 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298695+0000", 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7471999999999994e-05 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298707+0000", 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1379000000000001e-05 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301022+0000", 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00231526 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301071+0000", 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.757957165000001, 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049479429999999998, 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298894+0000", 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298909+0000", 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4646e-05 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298921+0000", 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2830000000000001e-05 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298942+0000", 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0462000000000002e-05 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298993+0000", 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0968999999999999e-05 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299001+0000", 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1319999999999994e-06 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303821+0000", 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048198410000000001 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303843+0000", 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1846000000000001e-05 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 45/33 ECSubWrite(tid=79, reqid=client.4589.0:295, at_version=45'24, trim_to=0'0, roll_forward_to=44'22))", 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.732548815000001, 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052771249999999997, 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324448+0000", 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014492199999999999 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324465+0000", 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6928000000000001e-05 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324473+0000", 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4290000000000001e-06 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324536+0000", 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3182000000000006e-05 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324547+0000", 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0407999999999999e-05 2024-09-18T10:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329548+0000", 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050016779999999999 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329580+0000", 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1859000000000001e-05 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 45/33 ECSubWrite(tid=80, reqid=client.4589.0:295, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.724378377999997, 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002518607, 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332473+0000", 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332485+0000", 2024-09-18T10:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2669e-05 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332500+0000", 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.472e-05 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332508+0000", 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6480000000000003e-06 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332567+0000", 2024-09-18T10:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9750999999999998e-05 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332577+0000", 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7070000000000004e-06 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.334961+0000", 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023839180000000001 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.334992+0000", 2024-09-18T10:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1109000000000003e-05 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.449809535, 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023816800000000002, 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607066+0000", 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4323000000000001e-05 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607084+0000", 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7872000000000001e-05 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607091+0000", 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2239999999999998e-06 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607153+0000", 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1663999999999998e-05 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607163+0000", 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8989999999999996e-06 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.609402+0000", 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022393780000000002 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.609424+0000", 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 56/33 ECSubWrite(tid=213, reqid=client.4589.0:458, at_version=56'58, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.415541693000002, 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028836209999999998, 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641309+0000", 2024-09-18T10:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641330+0000", 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0845000000000001e-05 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641581+0000", 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025098500000000001 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641589+0000", 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5650000000000004e-06 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641637+0000", 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8804999999999998e-05 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641647+0000", 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644164+0000", 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002517437 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644194+0000", 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9390000000000002e-05 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(3.as1 epoch 56/33 rep_tid 121 entries 56'31 (0'0) error 3:52d3343a:::smithi16036501-18:head by client.4589.0:461 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 49'28)", 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.414212622000001, 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024779099999999998, 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642654+0000", 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4662e-05 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642672+0000", 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8542999999999998e-05 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642696+0000", 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3676000000000002e-05 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642783+0000", 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7560999999999997e-05 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645117+0000", 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023339139999999999 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.414132807999998, 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00237638, 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642739+0000", 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0530000000000002e-05 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642762+0000", 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2841999999999999e-05 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642770+0000", 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5920000000000003e-06 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642820+0000", 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0701000000000001e-05 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642830+0000", 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0086e-05 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645068+0000", 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022371769999999999 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645095+0000", 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7883000000000001e-05 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 56/33 ECSubWrite(tid=125, reqid=osd.13.0:125, at_version=56'33, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.402063169000002, 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062986129999999998, 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654788+0000", 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654813+0000", 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5276999999999999e-05 2024-09-18T10:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654829+0000", 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5387999999999999e-05 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654835+0000", 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8990000000000004e-06 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654888+0000", 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3004999999999998e-05 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654900+0000", 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.661062+0000", 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061620340000000003 2024-09-18T10:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.661087+0000", 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789999999999999e-05 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.454813968, 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030576539999999999, 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602066+0000", 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8413000000000001e-05 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602076+0000", 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0227000000000001e-05 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602083+0000", 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.331e-06 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602173+0000", 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9917e-05 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602183+0000", 2024-09-18T10:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893000000000001e-05 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605062+0000", 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028786240000000002 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605096+0000", 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3578000000000003e-05 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=237, reqid=osd.4.0:237, at_version=60'72, trim_to=0'0, roll_forward_to=59'70))", 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.454096724999999, 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002715496, 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602779+0000", 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4559e-05 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602792+0000", 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2183e-05 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602798+0000", 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5379999999999999e-06 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602861+0000", 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3260000000000001e-05 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602876+0000", 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.464e-05 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605441+0000", 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025647399999999998 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605471+0000", 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.989e-05 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=242, reqid=osd.4.0:239, at_version=0'0, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.445602058999999, 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663030000000001, 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611249+0000", 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611263+0000", 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3712e-05 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611278+0000", 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5489e-05 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611286+0000", 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4390000000000003e-06 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611354+0000", 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8612e-05 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611374+0000", 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:32:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614397+0000", 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030227909999999999 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614416+0000", 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9406999999999999e-05 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=243, reqid=osd.4.0:243, at_version=60'76, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.444274777, 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043321790000000002, 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612576+0000", 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612598+0000", 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2039999999999999e-05 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612610+0000", 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1712999999999999e-05 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612615+0000", 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9219999999999996e-06 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612676+0000", 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0674000000000002e-05 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612688+0000", 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2687000000000001e-05 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616881+0000", 2024-09-18T10:32:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041925180000000001 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616909+0000", 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8391999999999999e-05 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=244, reqid=osd.4.0:244, at_version=60'78, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.443185462999999, 2024-09-18T10:32:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061258190000000002, 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613685+0000", 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9247000000000001e-05 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613696+0000", 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1361e-05 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613701+0000", 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0030000000000002e-06 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613740+0000", 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9100000000000002e-05 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613764+0000", 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3413000000000001e-05 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619771+0000", 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060067280000000002 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619792+0000", 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1707000000000001e-05 2024-09-18T10:32:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.455260613, 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026074700000000002, 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601684+0000", 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2781999999999994e-05 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601697+0000", 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601704+0000", 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.754e-06 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601779+0000", 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4917000000000001e-05 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601791+0000", 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2808e-05 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604162+0000", 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023708620000000001 2024-09-18T10:32:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604199+0000", 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6424000000000002e-05 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 85/33 ECSubWrite(tid=217, reqid=osd.13.0:217, at_version=85'49, trim_to=0'0, roll_forward_to=84'47))", 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4389227699999996, 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036460580000000002, 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617949+0000", 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0370999999999999e-05 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617963+0000", 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4341999999999999e-05 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617970+0000", 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5880000000000003e-06 2024-09-18T10:32:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618027+0000", 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7055999999999997e-05 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618044+0000", 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6974e-05 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.621551+0000", 2024-09-18T10:32:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035064800000000002 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.621575+0000", 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4651000000000002e-05 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 85/77 ECSubWrite(tid=218, reqid=osd.13.0:218, at_version=85'26, trim_to=0'0, roll_forward_to=84'24))", 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4382507020000004, 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003463069, 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618627+0000", 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5891999999999999e-05 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618637+0000", 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0445000000000001e-05 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618645+0000", 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0399999999999993e-06 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618695+0000", 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9654000000000003e-05 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618706+0000", 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0954999999999999e-05 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.622044+0000", 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033382709999999999 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.622064+0000", 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0384999999999999e-05 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 85/77 ECSubWrite(tid=149, reqid=osd.3.0:149, at_version=85'107, trim_to=0'0, roll_forward_to=84'105))", 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4375106669999997, 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039359169999999997, 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619360+0000", 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9145000000000001e-05 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619371+0000", 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1124999999999999e-05 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619379+0000", 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9659999999999996e-06 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619427+0000", 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7911999999999998e-05 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619438+0000", 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0380000000000001e-05 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623252+0000", 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038148990000000001 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623277+0000", 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4752e-05 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 85/77 ECSubWrite(tid=150, reqid=osd.3.0:150, at_version=85'109, trim_to=0'0, roll_forward_to=84'105))", 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.619530+0000", 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4373223490000004, 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044605699999999996, 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619530+0000", 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619530+0000", 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619529+0000", 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619552+0000", 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3611000000000001e-05 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619565+0000", 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2648e-05 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619575+0000", 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5240000000000006e-06 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.621993+0000", 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024186339999999998 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.622003+0000", 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7399999999999999e-06 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623969+0000", 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019658290000000001 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623990+0000", 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.154 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:14.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:32:14.156 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:14.155+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:14.253 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.254 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:14.254 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:14.254 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:14.256 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:14.255+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:14.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:32:14.358 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:14.359 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:14.359 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:14.359 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:14.357+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:14.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:32:14.459 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:14.458+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:14.466 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.466 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:14.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:14.466 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:32:14.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.466 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:206 3.cs0 3:3616aa10:::smithi16036501-19:2 [read 0~1179648,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:14.467 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:32:14.467 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.193685344000002, 2024-09-18T10:32:14.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081552699999999992, 2024-09-18T10:32:14.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.467 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.468 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-09-18T10:32:14.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.468 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270074+0000", 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270073+0000", 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270076+0000", 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1389999999999999e-06 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270082+0000", 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8329999999999999e-06 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270087+0000", 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7589999999999997e-06 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270158+0000", 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1110000000000002e-05 2024-09-18T10:32:14.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.270163+0000", 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1370000000000001e-06 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275879+0000", 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005716133 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.275935+0000", 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5587999999999997e-05 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:24.278229+0000", 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022939829999999999 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:436 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~770048] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:14.473 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.741530320999999, 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011429902, 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 436 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:32:14.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722227+0000", 2024-09-18T10:32:14.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723088+0000", 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086064300000000002 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723103+0000", 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5194000000000001e-05 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723126+0000", 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3286e-05 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723184+0000", 2024-09-18T10:32:14.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8409000000000003e-05 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723195+0000", 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0127e-05 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725088+0000", 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932479999999999 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725155+0000", 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7061e-05 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.726518+0000", 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001363076 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730117+0000", 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003598778 2024-09-18T10:32:14.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733596+0000", 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034793699999999999 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733659+0000", 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2459999999999995e-05 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:437 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~475136] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.738389564999999, 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013490482, 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 437 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725368+0000", 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725831+0000", 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046283199999999999 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725844+0000", 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3121e-05 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725851+0000", 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.674e-06 2024-09-18T10:32:14.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727646+0000", 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017952199999999999 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727719+0000", 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3166999999999999e-05 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728450+0000", 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073089599999999998 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730201+0000", 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001750564 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738806+0000", 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008605171 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738860+0000", 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4008999999999997e-05 2024-09-18T10:32:14.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:438 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~294912] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.736665164999998, 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01193583, 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.486 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 438 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:32:14.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727093+0000", 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727437+0000", 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034437500000000001 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727451+0000", 2024-09-18T10:32:14.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4089e-05 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727463+0000", 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2179e-05 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728987+0000", 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015242299999999999 2024-09-18T10:32:14.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729057+0000", 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9201000000000004e-05 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729526+0000", 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046947999999999998 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731168+0000", 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016422959999999999 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738978+0000", 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078093099999999999 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739030+0000", 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1910999999999998e-05 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:439 3.5s0 3:ac3be3d0:::smithi16036501-3:head [setxattr _header (56) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.736287431000001, 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011721551, 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.492 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 439 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727471+0000", 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727476+0000", 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1399999999999999e-06 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727485+0000", 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4590000000000004e-06 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727492+0000", 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4450000000000001e-06 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730312+0000", 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028200730000000002 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730376+0000", 2024-09-18T10:32:14.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3989e-05 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730729+0000", 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353099 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731679+0000", 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095002300000000003 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739133+0000", 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074541119999999997 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739193+0000", 2024-09-18T10:32:14.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0016000000000003e-05 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:440 3.5s0 3:ac3be3d0:::smithi16036501-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.7362599, 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013207774, 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.498 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 440 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727503+0000", 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2220000000000004e-06 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727512+0000", 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1789999999999997e-06 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727521+0000", 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730982+0000", 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003461357 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731094+0000", 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011191700000000001 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739479+0000", 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083848180000000005 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739571+0000", 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1942999999999997e-05 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.740707+0000", 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011359429999999999 2024-09-18T10:32:14.503 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:450 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~786432] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.684953514999997, 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083772540000000006, 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.504 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 450 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778805+0000", 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.778803+0000", 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779445+0000", 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064144400000000002 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779458+0000", 2024-09-18T10:32:14.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3027000000000001e-05 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779462+0000", 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5859999999999998e-06 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779514+0000", 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1320000000000003e-05 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.779580+0000", 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6484999999999998e-05 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.780535+0000", 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095481799999999996 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.781925+0000", 2024-09-18T10:32:14.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013899489999999999 2024-09-18T10:32:14.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787115+0000", 2024-09-18T10:32:14.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051898500000000002 2024-09-18T10:32:14.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.787183+0000", 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8021999999999993e-05 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:456 3.5s0 3:ac3be3d0:::smithi16036501-3:head [copy-from ver 4] snapc 13=[d,6] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:32:14.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.823508404000002, 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01601, 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 456 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:32:14.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640248+0000", 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640263+0000", 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4487e-05 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640282+0000", 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9524000000000001e-05 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640289+0000", 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5939999999999999e-06 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9294000000000004e-05 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640367+0000", 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0170000000000002e-06 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645378+0000", 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050108269999999998 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645496+0000", 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118449 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.649412+0000", 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039156800000000004 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650429+0000", 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00101706 2024-09-18T10:32:14.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656201+0000", 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057721049999999996 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656261+0000", 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9450999999999997e-05 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:457 3.5s0 3:ac3be3d0:::smithi16036501-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.823454216999998, 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099350510000000003, 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 457 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:32:14.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640304+0000", 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640308+0000", 2024-09-18T10:32:14.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.631e-06 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640315+0000", 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4590000000000001e-06 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640319+0000", 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.721e-06 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640554+0000", 2024-09-18T10:32:14.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000235047 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640562+0000", 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1110000000000008e-06 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645694+0000", 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051315149999999997 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:14.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645744+0000", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0756e-05 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650099+0000", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043545509999999999 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650157+0000", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8363999999999999e-05 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650240+0000", 2024-09-18T10:32:14.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2596000000000007e-05 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 56/33 ECSubWrite(tid=125, reqid=osd.13.0:125, at_version=56'33, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.808926419999999, 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084899620000000002, 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654833+0000", 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654832+0000", 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654874+0000", 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1996999999999998e-05 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654890+0000", 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6705999999999999e-05 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654898+0000", 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654955+0000", 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7389000000000002e-05 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654966+0000", 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1353e-05 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663290+0000", 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083236720000000007 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.663323+0000", 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2360999999999997e-05 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:485 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.868365645000001, 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092164380000000004, 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 485 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:32:14.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595391+0000", 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595401+0000", 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559999999999994e-06 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595421+0000", 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.052e-05 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595430+0000", 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8149999999999995e-06 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595492+0000", 2024-09-18T10:32:14.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2297000000000003e-05 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0696999999999999e-05 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597238+0000", 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017347510000000001 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597314+0000", 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5784000000000005e-05 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597920+0000", 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060640599999999998 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600840+0000", 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029203670000000001 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604512+0000", 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036712759999999998 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8109000000000005e-05 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:486 3.cs0 3:3616aa10:::smithi16036501-19:head [rollback 17] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.868280983999998, 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095267909999999997, 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 486 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595477+0000", 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595482+0000", 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9559999999999996e-06 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595489+0000", 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.866e-06 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595493+0000", 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4630000000000001e-06 2024-09-18T10:32:14.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595574+0000", 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1390999999999994e-05 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595580+0000", 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2330000000000003e-06 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598599+0000", 2024-09-18T10:32:14.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003018813 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598675+0000", 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6198000000000005e-05 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.599265+0000", 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058946400000000005 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604855+0000", 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055906949999999997 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604930+0000", 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5139e-05 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605005+0000", 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4320000000000007e-05 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:487 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.868260840000001, 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015332254999999999, 2024-09-18T10:32:14.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 487 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:14.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:32:14.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595500+0000", 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7999999999999999e-06 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3380000000000001e-06 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595505+0000", 2024-09-18T10:32:14.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2419999999999999e-06 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595603+0000", 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7980999999999996e-05 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595610+0000", 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5710000000000003e-06 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600005+0000", 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043948529999999998 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600140+0000", 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135184 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600625+0000", 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048546199999999998 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605009+0000", 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043837019999999997 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610750+0000", 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057406339999999997 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610830+0000", 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0711999999999996e-05 2024-09-18T10:32:14.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:543 3.cs0 3:33d93753:::smithi16036501-12:head [copy-from ver 35] snapc 1e=[1e] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.810345856000001, 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013133835, 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 543 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653412+0000", 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653419+0000", 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.525e-06 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653431+0000", 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024999999999999e-05 2024-09-18T10:32:14.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653436+0000", 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1070000000000004e-06 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653469+0000", 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3037000000000002e-05 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653533+0000", 2024-09-18T10:32:14.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3468999999999998e-05 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.661263+0000", 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007729774 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662684+0000", 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014210920000000001 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.666504+0000", 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003820164 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.666547+0000", 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3142000000000001e-05 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:544 3.cs0 3:33d93753:::smithi16036501-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.810316739000001, 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089048649999999997, 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 544 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.553 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:14.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653444+0000", 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7179999999999999e-06 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653448+0000", 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9020000000000001e-06 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653450+0000", 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2680000000000001e-06 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653638+0000", 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018801700000000001 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653671+0000", 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3623e-05 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662159+0000", 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084872190000000007 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662242+0000", 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2961999999999996e-05 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662347+0000", 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010546499999999999 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:669 3.cs0 3:3616aa10:::smithi16036501-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e75)", 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:59.739332+0000", 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.724427386, 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081744139999999996, 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 669 2024-09-18T10:32:14.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.739332+0000", 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.739332+0000", 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.739331+0000", 2024-09-18T10:32:14.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.739335+0000", 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5650000000000002e-06 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.739340+0000", 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9989999999999999e-06 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.739343+0000", 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9280000000000002e-06 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.741703+0000", 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002360689 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.741797+0000", 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3441000000000002e-05 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.744628+0000", 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028313729999999999 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.744699+0000", 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0360999999999999e-05 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:59.747506+0000", 2024-09-18T10:32:14.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028073619999999999 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:685 3.cs0 3:33d93753:::smithi16036501-12:head [append 0~557056] snapc 27=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:00.714998+0000", 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.748760554, 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0080934230000000006, 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.563 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 685 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.714998+0000", 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.714998+0000", 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.714997+0000", 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.715831+0000", 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00083403800000000005 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.715846+0000", 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5214999999999999e-05 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.715851+0000", 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3079999999999998e-06 2024-09-18T10:32:14.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.715895+0000", 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3615000000000002e-05 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.715984+0000", 2024-09-18T10:32:14.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8962999999999995e-05 2024-09-18T10:32:14.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.716699+0000", 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071511899999999995 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.717840+0000", 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011411780000000001 2024-09-18T10:32:14.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.723003+0000", 2024-09-18T10:32:14.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051626440000000001 2024-09-18T10:32:14.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.723092+0000", 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8858999999999997e-05 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:687 3.cs0 3:33d93753:::smithi16036501-12:head [append 0~507904] snapc 27=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:00.720671+0000", 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.743088426, 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085742869999999999, 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.572 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.573 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.573 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.573 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.573 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 687 2024-09-18T10:32:14.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.573 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.720671+0000", 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.720671+0000", 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.720669+0000", 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:14.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.721277+0000", 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060807199999999997 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.721286+0000", 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5390000000000007e-06 2024-09-18T10:32:14.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.721290+0000", 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5109999999999997e-06 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.721329+0000", 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8726000000000002e-05 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.721429+0000", 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010022399999999999 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.722167+0000", 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073814599999999996 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.723575+0000", 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014073099999999999 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.729170+0000", 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055955390000000001 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.729245+0000", 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4615000000000003e-05 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:691 3.cs0 3:33d93753:::smithi16036501-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:14.579 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.738621838, 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090110829999999996, 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725140+0000", 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725147+0000", 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6120000000000004e-06 2024-09-18T10:32:14.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725151+0000", 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8199999999999998e-06 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.730361+0000", 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052106000000000001 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.730413+0000", 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1345999999999999e-05 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.731457+0000", 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001043867 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.731545+0000", 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8509000000000002e-05 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.734148+0000", 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026031330000000001 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:824 3.5s0 3:a1445e23:::smithi16036501-34:head [append 0~425984] snapc 33=[33,30] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:10.619561+0000", 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.8441980920000001, 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090713410000000001, 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.585 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 824 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.619561+0000", 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.619561+0000", 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.619557+0000", 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999967 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620248+0000", 2024-09-18T10:32:14.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069106400000000002 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620274+0000", 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5282e-05 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620285+0000", 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0889e-05 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620345+0000", 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9988999999999998e-05 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620351+0000", 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4899999999999997e-06 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.622203+0000", 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001852013 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.622264+0000", 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1173000000000005e-05 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.622864+0000", 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060004100000000005 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.623773+0000", 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090852800000000003 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.628586+0000", 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048133890000000004 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.628632+0000", 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5952999999999999e-05 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.591 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:14.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:32:14.593 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:14.592+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:14.635 INFO:tasks.rados.rados.0.smithi160.stdout:340: done (0 left) 2024-09-18T10:32:14.635 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 34 current snap is 28 2024-09-18T10:32:14.635 INFO:tasks.rados.rados.0.smithi160.stdout:341: seq_num 149 ranges {2375680=98304} 2024-09-18T10:32:14.648 INFO:tasks.rados.rados.0.smithi160.stdout:341: writing smithi16036501-34 from 2375680 to 2473984 tid 1 2024-09-18T10:32:14.648 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 38 current snap is 28 2024-09-18T10:32:14.648 INFO:tasks.rados.rados.0.smithi160.stdout:342: seq_num 150 ranges {8142848=114688} 2024-09-18T10:32:14.691 INFO:tasks.rados.rados.0.smithi160.stdout:342: writing smithi16036501-38 from 8142848 to 8257536 tid 1 2024-09-18T10:32:14.691 INFO:tasks.rados.rados.0.smithi160.stdout:343: snap_create 2024-09-18T10:32:14.692 INFO:tasks.rados.rados.0.smithi160.stdout:341: finishing write tid 1 to smithi16036501-34 2024-09-18T10:32:14.692 INFO:tasks.rados.rados.0.smithi160.stdout:341: finishing write tid 2 to smithi16036501-34 2024-09-18T10:32:14.692 INFO:tasks.rados.rados.0.smithi160.stdout:341: finishing write tid 3 to smithi16036501-34 2024-09-18T10:32:14.692 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 34 v 49 (ObjNum 149 snap 28 seq_num 149) dirty exists 2024-09-18T10:32:14.692 INFO:tasks.rados.rados.0.smithi160.stdout:341: left oid 34 (ObjNum 149 snap 28 seq_num 149) 2024-09-18T10:32:14.693 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:14.692+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:14.698 INFO:tasks.rados.rados.0.smithi160.stdout:342: finishing write tid 1 to smithi16036501-38 2024-09-18T10:32:14.699 INFO:tasks.rados.rados.0.smithi160.stdout:342: finishing write tid 2 to smithi16036501-38 2024-09-18T10:32:14.700 INFO:tasks.rados.rados.0.smithi160.stdout:342: finishing write tid 3 to smithi16036501-38 2024-09-18T10:32:14.700 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 116 (ObjNum 150 snap 28 seq_num 150) dirty exists 2024-09-18T10:32:14.700 INFO:tasks.rados.rados.0.smithi160.stdout:342: left oid 38 (ObjNum 150 snap 28 seq_num 150) 2024-09-18T10:32:14.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:32:14.776 INFO:teuthology.orchestra.run.smithi071.stdout:m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P 2024-09-18T10:32:14.779 INFO:tasks.thrashosds.thrasher:applying new sharding to bluestore on osd.9 2024-09-18T10:32:14.780 INFO:tasks.thrashosds.thrasher:generate random sharding 2024-09-18T10:32:14.780 INFO:tasks.thrashosds.thrasher:applying new sharding: m(5,8-16) P(2,0-) 2024-09-18T10:32:14.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-9 --sharding 'm(5,8-16) P(2,0-)' reshard 2024-09-18T10:32:14.795 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:14.794+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:14.802 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.802 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:14.802 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:14.802 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:14.802 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:14.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:32:14.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:32:14.828+0000 7ff574ef7780 -1 bluestore::NCB::__restore_allocator::No Valid allocation info on disk (empty file) 2024-09-18T10:32:14.896 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:14.895+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:14.928 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:14.928 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:14.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:14.928 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:32:14.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 69.740824094999994, 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.349076098, 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-09-18T10:32:14.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185093+0000", 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999952 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185102+0000", 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185111+0000", 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4130000000000006e-06 2024-09-18T10:32:14.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185116+0000", 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0080000000000002e-06 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185151+0000", 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5216000000000003e-05 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185156+0000", 2024-09-18T10:32:14.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5090000000000001e-06 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534040+0000", 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.34888328099999999 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534174+0000", 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134129 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 67.740910033000006, 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010537852, 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185009+0000", 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185021+0000", 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024e-05 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185062+0000", 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0363e-05 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185072+0000", 2024-09-18T10:32:14.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0712e-05 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185133+0000", 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0458999999999998e-05 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185140+0000", 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1720000000000001e-06 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190251+0000", 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051104840000000002 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190319+0000", 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8640999999999996e-05 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190422+0000", 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102576 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.191693+0000", 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012707980000000001 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195487+0000", 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003794651 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195521+0000", 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3760999999999997e-05 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195550+0000", 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742e-05 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:202 3.fs0 3:f4795e34:::smithi16036501-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e38)", 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.647208769000002, 2024-09-18T10:32:14.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081974649999999993, 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 202 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:32:14.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:32:14.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278713+0000", 2024-09-18T10:32:14.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278715+0000", 2024-09-18T10:32:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3609999999999999e-06 2024-09-18T10:32:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278722+0000", 2024-09-18T10:32:14.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5520000000000001e-06 2024-09-18T10:32:14.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.278725+0000", 2024-09-18T10:32:14.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8770000000000003e-06 2024-09-18T10:32:14.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280064+0000", 2024-09-18T10:32:14.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013385389999999999 2024-09-18T10:32:14.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:14.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.280120+0000", 2024-09-18T10:32:14.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5856999999999997e-05 2024-09-18T10:32:14.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286097+0000", 2024-09-18T10:32:14.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059775230000000002 2024-09-18T10:32:14.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286178+0000", 2024-09-18T10:32:14.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0519999999999995e-05 2024-09-18T10:32:14.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:23.286911+0000", 2024-09-18T10:32:14.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073268499999999996 2024-09-18T10:32:14.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.951 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:278 3.as0 3:597221c7:::smithi16036501-40:head [create,setxattr dj[s][nsgcdlaO`ntnnogS`sZdZO[V\\]llWi\\gjj (11296) in=40b,setxattr qRNaVOjbUaQsk\\XsiZbOhrsOSoqX_Tqndtkb\\_Sa (1297) in=40b,setxattr `hdQPrsh[aUo`rPcbh\\tWT\\PatkS^p[P_Pdmcgdi (840) in=40b,setxattr RXicf\\^UcqO_mXh^am]mfcdttd\\mfOiPqZcomOo` (1822) in=40b,setxattr oZlXqWbdtOrc_U_m[apaV_Nr[hOOUgj`sVNpq^Rp (1473) in=40b,setxattr TrdTbcloOaiWXhjih\\mdXfYZcg\\^aOrnVOj^sf`s (10104) in=40b,setxattr XftrktNgjnZekN[]^ls\\[htgSaXkUrlVOqS[WcNt (1263) in=40b,setxattr ^qaVseQnk[`qOXVa`m]]NtQ\\psXaNYand^tQYrWt (1051) in=40b,setxattr b_e\\_i^rj`csr^q^\\e_boR\\lQNhcZg_NVqpgUQ`Q (418) in=40b,setxattr cfoPTk\\o\\Qqbi^XNOW[dbpcRb`OledY]YqcmmqUr (19016) in=40b,setxattr qjofnWtf]NipeS]\\gcjdaepnS_Pi^QgbRZd (10104) in=35b,setxattr mtVO^NRpeT]rQZYdTadneUO_^VXn^UdhZ^\\bUQiR (769) in=40b,setxattr prahkiNnm`U[rXSatop\\lk_p\\WVkdatg[XURZrsm (4560) in=40b,setxattr isZNUepUtPtRnYQaXpfelSVVR\\apSohRfqcfV`T_ (10033) in=40b,setxattr QZkproN[Zssrnra[rrbkaSXpatcreQpt`tWbOdoO (8349) in=40b,setxattr YqVPkaeiY^Tbe\\Rr\\heXkWjtOsi`iaN[TO\\^kP^] (876) in=40b,setxattr ZdfcZ]]snWVj]dZhZ]YSjVneRRoNbk`d^een^nqN (3368) in=40b,setxattr Y^XWcNfadqaYlbNpPbVRoPtgWreNtPrhWlfbbYY] (10804) in=40b,setxattr a`l_j\\^WlXY[ekSUURUhO (10104) in=21b,setxattr YgOToR[hPbQocWaoh\\h_NkYaghbpdean`\\kalgQ[ (1541) in=40b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:14.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:32:14.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.607990749999999, 2024-09-18T10:32:14.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010663587, 2024-09-18T10:32:14.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:14.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.953 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 278 2024-09-18T10:32:14.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:32:14.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:32:14.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317930+0000", 2024-09-18T10:32:14.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:14.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318130+0000", 2024-09-18T10:32:14.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020014100000000001 2024-09-18T10:32:14.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318141+0000", 2024-09-18T10:32:14.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1308000000000001e-05 2024-09-18T10:32:14.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318146+0000", 2024-09-18T10:32:14.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:32:14.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318184+0000", 2024-09-18T10:32:14.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8597000000000003e-05 2024-09-18T10:32:14.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318296+0000", 2024-09-18T10:32:14.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111852 2024-09-18T10:32:14.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:14.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319182+0000", 2024-09-18T10:32:14.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088532300000000003 2024-09-18T10:32:14.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:14.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.321095+0000", 2024-09-18T10:32:14.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001913131 2024-09-18T10:32:14.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:14.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328552+0000", 2024-09-18T10:32:14.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074568689999999997 2024-09-18T10:32:14.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328595+0000", 2024-09-18T10:32:14.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3090999999999998e-05 2024-09-18T10:32:14.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.965 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:292 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:14.965 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:32:14.966 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.615139523000003, 2024-09-18T10:32:14.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010659095, 2024-09-18T10:32:14.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.967 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 292 2024-09-18T10:32:14.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.967 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:32:14.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:32:14.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310780+0000", 2024-09-18T10:32:14.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:14.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310799+0000", 2024-09-18T10:32:14.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9327e-05 2024-09-18T10:32:14.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310820+0000", 2024-09-18T10:32:14.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0859000000000001e-05 2024-09-18T10:32:14.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310829+0000", 2024-09-18T10:32:14.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9600000000000006e-06 2024-09-18T10:32:14.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:32:14.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4290999999999999e-05 2024-09-18T10:32:14.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:14.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310889+0000", 2024-09-18T10:32:14.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1909999999999999e-06 2024-09-18T10:32:14.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316357+0000", 2024-09-18T10:32:14.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054682480000000002 2024-09-18T10:32:14.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316408+0000", 2024-09-18T10:32:14.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1192e-05 2024-09-18T10:32:14.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.321441+0000", 2024-09-18T10:32:14.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050333549999999998 2024-09-18T10:32:14.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.978 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:293 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:14.978 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:32:14.978 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.615081275000001, 2024-09-18T10:32:14.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011301637999999999, 2024-09-18T10:32:14.978 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 293 2024-09-18T10:32:14.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.980 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:32:14.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:32:14.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310840+0000", 2024-09-18T10:32:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310844+0000", 2024-09-18T10:32:14.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2350000000000001e-06 2024-09-18T10:32:14.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310854+0000", 2024-09-18T10:32:14.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9340000000000001e-06 2024-09-18T10:32:14.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310859+0000", 2024-09-18T10:32:14.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9869999999999999e-06 2024-09-18T10:32:14.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310943+0000", 2024-09-18T10:32:14.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3727999999999995e-05 2024-09-18T10:32:14.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:14.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310949+0000", 2024-09-18T10:32:14.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1800000000000001e-06 2024-09-18T10:32:14.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316672+0000", 2024-09-18T10:32:14.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057234160000000003 2024-09-18T10:32:14.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:14.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316761+0000", 2024-09-18T10:32:14.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8483e-05 2024-09-18T10:32:14.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:14.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.322142+0000", 2024-09-18T10:32:14.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053813089999999999 2024-09-18T10:32:14.989 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.989 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:14.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:14.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:294 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:14.990 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:32:14.990 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.615038153999997, 2024-09-18T10:32:14.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012181983, 2024-09-18T10:32:14.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:14.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:14.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:14.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:14.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:14.992 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 294 2024-09-18T10:32:14.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.992 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:14.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:14.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:32:14.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:14.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:32:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:32:14.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:14.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:14.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310886+0000", 2024-09-18T10:32:14.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8210000000000002e-06 2024-09-18T10:32:14.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:14.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310891+0000", 2024-09-18T10:32:14.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6439999999999999e-06 2024-09-18T10:32:14.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:14.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310897+0000", 2024-09-18T10:32:14.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3040000000000001e-06 2024-09-18T10:32:14.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310968+0000", 2024-09-18T10:32:14.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0729999999999995e-05 2024-09-18T10:32:14.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:14.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310973+0000", 2024-09-18T10:32:14.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.853e-06 2024-09-18T10:32:14.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:14.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:14.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:14.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317866+0000", 2024-09-18T10:32:15.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068931009999999996 2024-09-18T10:32:15.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317931+0000", 2024-09-18T10:32:15.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5177000000000003e-05 2024-09-18T10:32:15.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.323066+0000", 2024-09-18T10:32:15.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051347789999999999 2024-09-18T10:32:15.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.002 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.002 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:295 3.as0 3:597221c7:::smithi16036501-40:head [copy-from ver 12] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:15.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:15.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.615022029000002, 2024-09-18T10:32:15.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021473249999999999, 2024-09-18T10:32:15.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 295 2024-09-18T10:32:15.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:15.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310909+0000", 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8190000000000003e-06 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310918+0000", 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0440000000000001e-06 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310923+0000", 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0430000000000001e-06 2024-09-18T10:32:15.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310964+0000", 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1553e-05 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310971+0000", 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6320000000000002e-06 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316320+0000", 2024-09-18T10:32:15.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053496139999999999 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316416+0000", 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5945000000000004e-05 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324379+0000", 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079626609999999994 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329447+0000", 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050681579999999997 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332330+0000", 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028824720000000001 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332373+0000", 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3553000000000001e-05 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:296 3.as0 3:597221c7:::smithi16036501-40:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.614989917000003, 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01562151, 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 296 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:15.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310934+0000", 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7549999999999999e-06 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310941+0000", 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5889999999999999e-06 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310946+0000", 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0259999999999998e-06 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310985+0000", 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8912000000000003e-05 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310988+0000", 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3469999999999999e-06 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316561+0000", 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055726819999999998 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316612+0000", 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0776000000000003e-05 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326337+0000", 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097256470000000005 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326429+0000", 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1984999999999994e-05 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326553+0000", 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012421900000000001 2024-09-18T10:32:15.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:361 3.fs0 3:f96c479d:::smithi16036501-23:head [copy-from ver 4] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.332492191999997, 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014671442, 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.017 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 361 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593428+0000", 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593438+0000", 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8490000000000001e-06 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593456+0000", 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8763999999999999e-05 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593464+0000", 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5469999999999999e-06 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593545+0000", 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0697000000000003e-05 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593554+0000", 2024-09-18T10:32:15.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0529999999999996e-06 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595269+0000", 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017153100000000001 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595397+0000", 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012801800000000001 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.602617+0000", 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072194609999999999 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607654+0000", 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005037489 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607731+0000", 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7068000000000001e-05 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.608101+0000", 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037002600000000002 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:362 3.fs0 3:f96c479d:::smithi16036501-23:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.332443189000003, 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010278183999999999, 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 362 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593478+0000", 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593482+0000", 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4399999999999998e-06 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593553+0000", 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0816999999999996e-05 2024-09-18T10:32:15.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593583+0000", 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9629999999999999e-05 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593637+0000", 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3905e-05 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593643+0000", 2024-09-18T10:32:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8199999999999999e-06 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595814+0000", 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021701160000000001 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595866+0000", 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2797999999999998e-05 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603570+0000", 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00770355 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603661+0000", 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1476000000000003e-05 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603757+0000", 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5461e-05 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.7s6 49/33 ECSubWrite(tid=170, reqid=osd.4.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.321531778999997, 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076710930000000004, 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604390+0000", 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604400+0000", 2024-09-18T10:32:15.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0104e-05 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604410+0000", 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0101999999999999e-05 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604415+0000", 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3539999999999999e-06 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604790+0000", 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037486699999999997 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.604798+0000", 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9759999999999995e-06 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612047+0000", 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072487979999999999 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.612061+0000", 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4395e-05 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:461 3.as0 3:52d3343a:::smithi16036501-18:head [delete] snapc 13=[d,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.285583385000002, 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01033507, 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.033 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 461 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640336+0000", 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640345+0000", 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7749999999999998e-06 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640361+0000", 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5313999999999999e-05 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640368+0000", 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2930000000000003e-06 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640442+0000", 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3814999999999997e-05 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640450+0000", 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3380000000000005e-06 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642167+0000", 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001716845 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642262+0000", 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5354999999999998e-05 2024-09-18T10:32:15.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650674+0000", 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084114099999999994 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:495 3.ds0 3:b4dda727:::smithi16036501-2:head [rmxattr NaWdn]fbrYUmjb`RnlX[nf]flgaVPdYaRaTsjd[_ in=40b,rmxattr Ndldqgh]PmQiPQt]XYQlRPtUrpta^^g`PPlosidN in=40b,rmxattr Wa^Tke^bWpgZXViVjeiO\\StNeTlrVofZXm\\afTgO in=40b,rmxattr XgVjiYZ\\UlNjf[Xcgc]kanprjmmN`TtrhXZN[NkY in=40b,rmxattr cTrrZmiZ\\drosZ^RTmSgdbdZt]RcZ\\RfciroNfea in=40b,rmxattr f[[l\\`WWX_\\^aPb`TiUX]la^kd_VbfYa^ha^[c[] in=40b,rmxattr nqUnbTdiWZdmero]g_b_`efZ\\^aTmXoU]\\Qfcao_ in=40b] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.326955474000002, 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010734373, 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 495 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598964+0000", 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598976+0000", 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2475e-05 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598996+0000", 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9901000000000001e-05 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599003+0000", 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0280000000000003e-06 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599063+0000", 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9731000000000001e-05 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599069+0000", 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2979999999999997e-06 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.600844+0000", 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001774767 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.600924+0000", 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9864999999999995e-05 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601669+0000", 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074501199999999997 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604092+0000", 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002423138 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609644+0000", 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055519419999999998 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609701+0000", 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6937000000000001e-05 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:561 3.fs0 3:f96c479d:::smithi16036501-23:head [copy-from ver 5] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.604960+0000", 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.320961465, 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014974804, 2024-09-18T10:32:15.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 561 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604960+0000", 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604960+0000", 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604958+0000", 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604970+0000", 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2333e-05 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604987+0000", 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7362000000000001e-05 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604996+0000", 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1429999999999998e-06 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605063+0000", 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7836999999999994e-05 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605070+0000", 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6429999999999998e-06 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607248+0000", 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002178358 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607351+0000", 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102774 2024-09-18T10:32:15.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.613666+0000", 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063143569999999996 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.615126+0000", 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014603719999999999 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:15.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.619881+0000", 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047554720000000002 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.619935+0000", 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3872000000000002e-05 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:562 3.fs0 3:f96c479d:::smithi16036501-23:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:15.050 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.320915735, 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099361510000000007, 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:15.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605009+0000", 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8600000000000001e-06 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605016+0000", 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5859999999999999e-06 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605020+0000", 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8449999999999996e-06 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605119+0000", 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9104000000000005e-05 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605126+0000", 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1690000000000003e-06 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607525+0000", 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398266 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607576+0000", 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1261000000000003e-05 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.614732+0000", 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007155771 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.614840+0000", 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108397 2024-09-18T10:32:15.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.614942+0000", 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102345 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:583 3.fs0 3:f184ba33:::smithi16036501-1:head [setxattr _header (56) in=7b] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.681521+0000", 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.244401308, 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078287430000000009, 2024-09-18T10:32:15.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 583 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681521+0000", 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681521+0000", 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681520+0000", 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681523+0000", 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1760000000000002e-06 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681530+0000", 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6900000000000003e-06 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681534+0000", 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7740000000000002e-06 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.682606+0000", 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001072422 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.682697+0000", 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0669999999999998e-05 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.683062+0000", 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036570899999999998 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.683627+0000", 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056435999999999997 2024-09-18T10:32:15.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.689298+0000", 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056712769999999997 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.689349+0000", 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1229e-05 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:584 3.fs0 3:f184ba33:::smithi16036501-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.244382945000002, 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089078920000000006, 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 584 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681542+0000", 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0479999999999999e-06 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681548+0000", 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1360000000000002e-06 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681551+0000", 2024-09-18T10:32:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2799999999999999e-06 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.683273+0000", 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001721562 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.683363+0000", 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0203000000000004e-05 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.689593+0000", 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062302709999999999 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.689645+0000", 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2298e-05 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.690447+0000", 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080147499999999995 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:831 3.fs0 3:f4795e34:::smithi16036501-42:head [copy-from ver 15] snapc 33=[33,30] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:10.631689+0000", 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2942329390000005, 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014676557999999999, 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 831 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631689+0000", 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631689+0000", 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631686+0000", 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:15.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631720+0000", 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3296000000000001e-05 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631752+0000", 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2647000000000001e-05 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631780+0000", 2024-09-18T10:32:15.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8093e-05 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631840+0000", 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9732999999999999e-05 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631850+0000", 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7850000000000003e-06 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.634788+0000", 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002938108 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.634874+0000", 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5774999999999998e-05 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.640550+0000", 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056764759999999997 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.642199+0000", 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016484150000000001 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.646293+0000", 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040945119999999998 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.646365+0000", 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2448999999999997e-05 2024-09-18T10:32:15.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:832 3.fs0 3:f4795e34:::smithi16036501-42:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e86)", 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2941146540000004, 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010017768, 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631810+0000", 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5389999999999999e-06 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631818+0000", 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1019999999999997e-06 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631822+0000", 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1160000000000001e-06 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631900+0000", 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7377000000000001e-05 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631906+0000", 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1340000000000001e-06 2024-09-18T10:32:15.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.635000+0000", 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030940680000000002 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.635112+0000", 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112298 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:15.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.641694+0000", 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065821450000000002 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.641759+0000", 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4134999999999995e-05 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.641825+0000", 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6429999999999999e-05 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:15.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:15.079 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:15.080 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:32:15.081 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:15.079+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:15.145 INFO:teuthology.orchestra.run.smithi071.stdout:reshard success 2024-09-18T10:32:15.181 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:15.180+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:15.189 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:15.190 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:15.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:32:15.282 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:15.281+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:15.297 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:32:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:32:15.297 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:15.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:32:15.383 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:15.382+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:15.403 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 44/33 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=44'39, trim_to=0'0, roll_forward_to=42'35))", 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 46.088293102000002, 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064675760000000001, 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313490+0000", 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313489+0000", 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313515+0000", 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6261000000000001e-05 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313533+0000", 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7538e-05 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313542+0000", 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4509999999999998e-06 2024-09-18T10:32:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313600+0000", 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7883999999999997e-05 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.313610+0000", 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7319999999999993e-06 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319944+0000", 2024-09-18T10:32:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063339829999999996 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319957+0000", 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 45/33 ECSubWrite(tid=53, reqid=client.4589.0:299, at_version=45'45, trim_to=0'0, roll_forward_to=44'41))", 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:32:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 45.073373515, 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056329550000000003, 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328409+0000", 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328408+0000", 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328607+0000", 2024-09-18T10:32:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00019832300000000001 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328623+0000", 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6240999999999999e-05 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328633+0000", 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0015e-05 2024-09-18T10:32:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328719+0000", 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.6198000000000004e-05 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.328731+0000", 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2055000000000001e-05 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334030+0000", 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052983739999999998 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.334042+0000", 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2646999999999999e-05 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=72, reqid=osd.3.0:72, at_version=60'60, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 30.798399806999999, 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058652940000000001, 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603383+0000", 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603404+0000", 2024-09-18T10:32:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1523e-05 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603416+0000", 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1263999999999999e-05 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603424+0000", 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0420000000000003e-06 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603495+0000", 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1149999999999995e-05 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.603505+0000", 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8579999999999995e-06 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609223+0000", 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057186440000000002 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.609248+0000", 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5168999999999999e-05 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=73, reqid=osd.3.0:73, at_version=60'62, trim_to=0'0, roll_forward_to=59'58))", 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 30.797414123999999, 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058440569999999997, 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604369+0000", 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604368+0000", 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604387+0000", 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9375999999999999e-05 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604401+0000", 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3591000000000001e-05 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604407+0000", 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7379999999999999e-06 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604451+0000", 2024-09-18T10:32:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4082999999999998e-05 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604460+0000", 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3500000000000003e-06 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610197+0000", 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057371849999999997 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610213+0000", 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5522000000000001e-05 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 60/33 ECSubWrite(tid=138, reqid=osd.13.0:138, at_version=60'64, trim_to=0'0, roll_forward_to=60'60))", 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:32:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 30.781820165999999, 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0087157520000000002, 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619963+0000", 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619962+0000", 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619982+0000", 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9661e-05 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.619994+0000", 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.205e-05 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620000+0000", 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8100000000000003e-06 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620036+0000", 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6171000000000003e-05 2024-09-18T10:32:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.620042+0000", 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8560000000000003e-06 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628654+0000", 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0086122119999999993 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628678+0000", 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4586000000000001e-05 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 60/33 ECSubWrite(tid=76, reqid=osd.3.0:75, at_version=0'0, trim_to=0'0, roll_forward_to=60'64))", 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 30.77966885, 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065928169999999999, 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622114+0000", 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622113+0000", 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622124+0000", 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1199999999999999e-05 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622137+0000", 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2866e-05 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622145+0000", 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2560000000000002e-06 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622196+0000", 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0878000000000003e-05 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.622207+0000", 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.11e-05 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628685+0000", 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064776080000000002 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.628707+0000", 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1889999999999999e-05 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 71/33 ECSubWrite(tid=171, reqid=client.4589.0:561, at_version=71'80, trim_to=0'0, roll_forward_to=64'78))", 2024-09-18T10:32:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 19.788023488, 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059379360000000004, 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.613759+0000", 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614740+0000", 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00098056300000000005 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614798+0000", 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8467000000000001e-05 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614809+0000", 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1014e-05 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614906+0000", 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.6414000000000002e-05 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.614917+0000", 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.146e-05 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.619658+0000", 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004740368 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.619697+0000", 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9765000000000003e-05 2024-09-18T10:32:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 71/33 ECSubWrite(tid=88, reqid=client.4589.0:573, at_version=71'74, trim_to=0'0, roll_forward_to=64'72))", 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 19.777366729000001, 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0061339209999999996, 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624416+0000", 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624415+0000", 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624669+0000", 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00025409299999999999 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624690+0000", 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.092e-05 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624698+0000", 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.695e-06 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624777+0000", 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9548999999999993e-05 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.624785+0000", 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7889999999999995e-06 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.630522+0000", 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057368669999999997 2024-09-18T10:32:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.630550+0000", 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7943999999999999e-05 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 71/33 ECSubWrite(tid=176, reqid=client.4589.0:583, at_version=71'85, trim_to=0'0, roll_forward_to=71'82))", 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 19.718729441000001, 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0060182889999999996, 2024-09-18T10:32:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683053+0000", 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683068+0000", 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5600999999999999e-05 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683079+0000", 2024-09-18T10:32:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0433e-05 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683084+0000", 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1279999999999999e-06 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683401+0000", 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00031686000000000003 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.683408+0000", 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6930000000000001e-06 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.689028+0000", 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056205059999999999 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.689072+0000", 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3671999999999998e-05 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=114, reqid=osd.0.0:114, at_version=75'91, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.701064+0000", 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.700718532, 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010252013000000001, 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701064+0000", 2024-09-18T10:32:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701064+0000", 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701063+0000", 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701100+0000", 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6189999999999997e-05 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701116+0000", 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6150999999999998e-05 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701123+0000", 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6179999999999997e-06 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701432+0000", 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030811199999999998 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701443+0000", 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1622e-05 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711289+0000", 2024-09-18T10:32:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0098456040000000009 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711316+0000", 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7608999999999999e-05 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=115, reqid=client.4589.0:658, at_version=75'92, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.702412+0000", 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.699371196, 2024-09-18T10:32:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089212700000000002, 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702412+0000", 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702412+0000", 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702411+0000", 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703060+0000", 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00064883699999999998 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703072+0000", 2024-09-18T10:32:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2567e-05 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703077+0000", 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0690000000000001e-06 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703117+0000", 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9557000000000001e-05 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703124+0000", 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9460000000000001e-06 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711321+0000", 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081973819999999996 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711333+0000", 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1684e-05 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s3 75/33 ECSubWrite(tid=70, reqid=osd.8.0:70, at_version=75'61, trim_to=0'0, roll_forward_to=73'59))", 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.695759571, 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0072873649999999996, 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706023+0000", 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706040+0000", 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6949999999999999e-05 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706053+0000", 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2745000000000001e-05 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706059+0000", 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3149999999999997e-06 2024-09-18T10:32:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706109+0000", 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706116+0000", 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1790000000000002e-06 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.713282+0000", 2024-09-18T10:32:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0071660170000000002 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.713311+0000", 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8617000000000001e-05 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=116, reqid=client.4589.0:659, at_version=75'93, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.706473+0000", 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.695309842, 2024-09-18T10:32:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085839699999999998, 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706473+0000", 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706473+0000", 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706472+0000", 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706822+0000", 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00034966100000000003 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706836+0000", 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4178e-05 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706843+0000", 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0589999999999997e-06 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706894+0000", 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0763000000000002e-05 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.706905+0000", 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1454000000000001e-05 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715029+0000", 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0081234280000000002 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715057+0000", 2024-09-18T10:32:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8450999999999999e-05 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=117, reqid=client.4589.0:660, at_version=75'94, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.707407+0000", 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.694375797999999, 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0076666390000000003, 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707407+0000", 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707407+0000", 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707406+0000", 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707440+0000", 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3365000000000003e-05 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707452+0000", 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2678e-05 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707459+0000", 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6080000000000001e-06 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709619+0000", 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021602570000000001 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709630+0000", 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.063e-05 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715062+0000", 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054324780000000001 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715074+0000", 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1528999999999999e-05 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.0s3 75/33 ECSubWrite(tid=99, reqid=osd.3.0:99, at_version=75'82, trim_to=0'0, roll_forward_to=73'80))", 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.693849545999999, 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0071916009999999997, 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707933+0000", 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707961+0000", 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7841e-05 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707978+0000", 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7e-05 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.707985+0000", 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8009999999999998e-06 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708048+0000", 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3507e-05 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708060+0000", 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1418e-05 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715088+0000", 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070287029999999999 2024-09-18T10:32:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715125+0000", 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6672999999999999e-05 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 75/33 ECSubWrite(tid=198, reqid=osd.13.0:198, at_version=75'99, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.693648036999999, 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0070372610000000004, 2024-09-18T10:32:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708135+0000", 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708181+0000", 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6687000000000002e-05 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708197+0000", 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5696999999999999e-05 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708205+0000", 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0630000000000006e-06 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708272+0000", 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7280000000000006e-05 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708282+0000", 2024-09-18T10:32:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4290000000000007e-06 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715141+0000", 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0068589810000000001 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715172+0000", 2024-09-18T10:32:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1374999999999997e-05 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s3 75/33 ECSubWrite(tid=118, reqid=client.4589.0:661, at_version=75'95, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.708697+0000", 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.693085841, 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064301979999999998, 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708697+0000", 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708697+0000", 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708696+0000", 2024-09-18T10:32:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708713+0000", 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6572999999999999e-05 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708725+0000", 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2098e-05 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.708731+0000", 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1840000000000004e-06 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711034+0000", 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0023025879999999999 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711044+0000", 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0135e-05 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715108+0000", 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0040643770000000001 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715127+0000", 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9097999999999999e-05 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.fs4 75/33 ECSubWrite(tid=199, reqid=osd.13.0:199, at_version=75'101, trim_to=0'0, roll_forward_to=73'97))", 2024-09-18T10:32:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.709162+0000", 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.692620655000001, 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00659912, 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709162+0000", 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709162+0000", 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709161+0000", 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709178+0000", 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6229999999999999e-05 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709189+0000", 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.101e-05 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.709195+0000", 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0419999999999999e-06 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711488+0000", 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022928610000000002 2024-09-18T10:32:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711497+0000", 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3589999999999997e-06 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715740+0000", 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0042433560000000002 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715761+0000", 2024-09-18T10:32:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1043000000000002e-05 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s6 75/33 ECSubWrite(tid=345, reqid=osd.4.0:345, at_version=75'60, trim_to=0'0, roll_forward_to=73'58))", 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.710066+0000", 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.69171725, 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056680639999999996, 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710066+0000", 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710066+0000", 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710065+0000", 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.710085+0000", 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9321999999999999e-05 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711269+0000", 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011847299999999999 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711277+0000", 2024-09-18T10:32:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.1339999999999998e-06 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.712858+0000", 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001581378 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.712868+0000", 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0458e-05 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715712+0000", 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028439910000000001 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.715734+0000", 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1330000000000001e-05 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s6 76/33 ECSubWrite(tid=356, reqid=client.4589.0:681, at_version=76'65, trim_to=0'0, roll_forward_to=76'62))", 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 14.686499543, 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065754630000000001, 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715283+0000", 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715307+0000", 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4057e-05 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715322+0000", 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5187e-05 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715329+0000", 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0690000000000004e-06 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715375+0000", 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.6078000000000002e-05 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715386+0000", 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0739e-05 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721831+0000", 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064451680000000003 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721859+0000", 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7903e-05 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.496 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:15.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:32:15.498 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:15.496+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:15.585 INFO:tasks.thrashosds.thrasher:running fsck to verify new sharding on osd.9 2024-09-18T10:32:15.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-9 fsck 2024-09-18T10:32:15.595 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:15.595 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:15.595 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:15.596 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:15.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:32:15.626 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:15.625+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:15.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:32:15.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-18T10:32:15.676+0000 7f01b24c9780 -1 bluestore::NCB::__restore_allocator::No Valid allocation info on disk (empty file) 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:341: done (2 left) 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:342: done (1 left) 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:343: done (0 left) 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:344: rollback oid 38 current snap is 29 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 38 to 28 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:345: copy_from oid 31 from oid 6 current snap is 29 2024-09-18T10:32:15.683 INFO:tasks.rados.rados.0.smithi160.stdout:346: read oid 9 snap 27 2024-09-18T10:32:15.684 INFO:tasks.rados.rados.0.smithi160.stdout:346: expect (ObjNum 102 snap 14 seq_num 102) 2024-09-18T10:32:15.684 INFO:tasks.rados.rados.0.smithi160.stdout:347: snap_create 2024-09-18T10:32:15.691 INFO:tasks.rados.rados.0.smithi160.stdout:344: finishing rollback tid 0 to smithi16036501-38 2024-09-18T10:32:15.692 INFO:tasks.rados.rados.0.smithi160.stdout:344: finishing rollback tid 1 to smithi16036501-38 2024-09-18T10:32:15.693 INFO:tasks.rados.rados.0.smithi160.stdout:346: expect (ObjNum 102 snap 14 seq_num 102) 2024-09-18T10:32:15.698 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:15.697+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:15.708 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:32:15.708 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:32:15.708 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:15.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:32:15.740 INFO:tasks.rados.rados.0.smithi160.stdout:344: finishing rollback tid 2 to smithi16036501-38 2024-09-18T10:32:15.740 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 38 v 120 (ObjNum 150 snap 28 seq_num 150) dirty exists 2024-09-18T10:32:15.740 INFO:tasks.rados.rados.0.smithi160.stdout:345: finishing copy_from racing read to smithi16036501-31 2024-09-18T10:32:15.740 INFO:tasks.rados.rados.0.smithi160.stdout:345: finishing copy_from to smithi16036501-31 2024-09-18T10:32:15.740 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 31 v 95 (ObjNum 121 snap 20 seq_num 121) dirty exists 2024-09-18T10:32:15.799 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:15.798+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 73.752828433000005, 2024-09-18T10:32:15.816 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76442072000000005, 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 1 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060654+0000", 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060653+0000", 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060661+0000", 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4030000000000007e-06 2024-09-18T10:32:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060672+0000", 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1005000000000001e-05 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060691+0000", 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8553e-05 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060740+0000", 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9666000000000002e-05 2024-09-18T10:32:15.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for peered", 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.060747+0000", 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1399999999999997e-06 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.823811+0000", 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.76306395100000002 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.820 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824007+0000", 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000196737 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824158+0000", 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000150913 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.824701+0000", 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054279800000000004 2024-09-18T10:32:15.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825007+0000", 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00030596600000000002 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825044+0000", 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6853000000000001e-05 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.822 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.825075+0000", 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1102000000000001e-05 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.818036547000005, 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089361909999999996, 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.823 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 47 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995446+0000", 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995550+0000", 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000104314 2024-09-18T10:32:15.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995559+0000", 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7069999999999998e-06 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995568+0000", 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1479999999999995e-06 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999298+0000", 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037306729999999999 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999379+0000", 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0304999999999998e-05 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.999486+0000", 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010773299999999999 2024-09-18T10:32:15.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001630+0000", 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0021436200000000002 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004321+0000", 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0026907049999999998 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.828 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004355+0000", 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4591000000000001e-05 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004382+0000", 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6869999999999999e-05 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.817887286000001, 2024-09-18T10:32:15.829 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0089699740000000003, 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 49 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995595+0000", 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995598+0000", 2024-09-18T10:32:15.831 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.495e-06 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995604+0000", 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4160000000000003e-06 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995607+0000", 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.439e-06 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.832 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000235+0000", 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0046279570000000003 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000284+0000", 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8316000000000003e-05 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000364+0000", 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.0117999999999994e-05 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.833 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002075+0000", 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001711064 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004511+0000", 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024360699999999998 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004542+0000", 2024-09-18T10:32:15.834 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0998999999999999e-05 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.004565+0000", 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3458000000000001e-05 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:32:15.835 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.817870034999999, 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011464667, 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 50 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.836 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995613+0000", 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.837 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995612+0000", 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995711+0000", 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8493999999999996e-05 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995719+0000", 2024-09-18T10:32:15.838 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4160000000000004e-06 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995724+0000", 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000646+0000", 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049220560000000002 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.839 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000740+0000", 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4660999999999994e-05 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.000883+0000", 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00014210199999999999 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002077+0000", 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0011947150000000001 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.840 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007015+0000", 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049376560000000003 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007053+0000", 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8469e-05 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007077+0000", 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3876999999999999e-05 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.817751604999998, 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011450287999999999, 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 51 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.842 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.843 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995731+0000", 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995730+0000", 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995735+0000", 2024-09-18T10:32:15.844 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.938e-06 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995741+0000", 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7810000000000002e-06 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995744+0000", 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2729999999999998e-06 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.845 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001284+0000", 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00553982 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001354+0000", 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9439999999999999e-05 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.846 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001433+0000", 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.9839000000000006e-05 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002242+0000", 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080809000000000002 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007122+0000", 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.004880428 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007150+0000", 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8309999999999998e-05 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.848 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007181+0000", 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1059000000000002e-05 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.817733204000007, 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011502327, 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.849 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 52 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.850 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995749+0000", 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995754+0000", 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1610000000000002e-06 2024-09-18T10:32:15.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995760+0000", 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2299999999999996e-06 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:02.995764+0000", 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6739999999999999e-06 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.852 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001659+0000", 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0058952459999999998 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001742+0000", 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2378000000000003e-05 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.001835+0000", 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.3710999999999998e-05 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.853 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.002405+0000", 2024-09-18T10:32:15.854 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00056997199999999997 2024-09-18T10:32:15.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.854 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.854 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007206+0000", 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048005959999999999 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007231+0000", 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.5449999999999999e-05 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.007252+0000", 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0319e-05 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.855 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.683623694000005, 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010184168, 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 71 2024-09-18T10:32:15.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.857 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129859+0000", 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129861+0000", 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1019999999999999e-06 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129864+0000", 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.898e-06 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129866+0000", 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0339999999999999e-06 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133579+0000", 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0037133029999999998 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133627+0000", 2024-09-18T10:32:15.859 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7700000000000001e-05 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133711+0000", 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3752999999999996e-05 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136265+0000", 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0025542759999999999 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.860 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.139993+0000", 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.003728543 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140023+0000", 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0103999999999998e-05 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140043+0000", 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:32:15.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.683614317999997, 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286735, 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.862 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 72 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.863 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129868+0000", 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129937+0000", 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8833999999999999e-05 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129943+0000", 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.6710000000000004e-06 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.864 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129946+0000", 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2480000000000001e-06 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133930+0000", 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039838319999999997 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.133979+0000", 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9802999999999997e-05 2024-09-18T10:32:15.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134057+0000", 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.7226999999999998e-05 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136267+0000", 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0022104440000000002 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.866 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140087+0000", 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0038197069999999999 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140117+0000", 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0156000000000001e-05 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140155+0000", 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8019000000000003e-05 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.683532611999993, 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010286248, 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 73 2024-09-18T10:32:15.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.869 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129950+0000", 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129952+0000", 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7420000000000002e-06 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129956+0000", 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0289999999999999e-06 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129959+0000", 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134509+0000", 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045500389999999996 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134554+0000", 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4984999999999997e-05 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.871 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134633+0000", 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8549999999999998e-05 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136269+0000", 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0016365489999999999 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140192+0000", 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039229299999999998 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140217+0000", 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4992000000000001e-05 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140236+0000", 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.895e-05 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.873 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.683497778000003, 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010335796, 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 74 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.874 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129985+0000", 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129984+0000", 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.875 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129989+0000", 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5680000000000001e-06 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129995+0000", 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.3350000000000003e-06 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.129999+0000", 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.9500000000000003e-06 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134856+0000", 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0048568020000000003 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134907+0000", 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1450999999999999e-05 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.134984+0000", 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6379999999999997e-05 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136272+0000", 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0012878449999999999 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140264+0000", 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039928409999999996 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140289+0000", 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4652999999999999e-05 2024-09-18T10:32:15.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.140321+0000", 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1550000000000001e-05 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.683469377999998, 2024-09-18T10:32:15.879 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.01270772, 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 75 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130013+0000", 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130094+0000", 2024-09-18T10:32:15.881 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1198000000000004e-05 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130104+0000", 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5789999999999993e-06 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130114+0000", 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0808000000000001e-05 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.882 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135231+0000", 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051164119999999999 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135281+0000", 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0305e-05 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135363+0000", 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2083999999999995e-05 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.883 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136275+0000", 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00091162199999999995 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142660+0000", 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063848919999999997 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142698+0000", 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8804999999999999e-05 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.884 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.142721+0000", 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2498e-05 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.683360581000002, 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.015446817, 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.885 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 76 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130122+0000", 2024-09-18T10:32:15.886 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130121+0000", 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130128+0000", 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.161e-06 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130135+0000", 2024-09-18T10:32:15.887 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.8189999999999992e-06 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.130139+0000", 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7340000000000002e-06 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135853+0000", 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057137840000000004 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135902+0000", 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9461e-05 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.135979+0000", 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6268999999999998e-05 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.136467+0000", 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00048846600000000001 2024-09-18T10:32:15.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145517+0000", 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0090497459999999991 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145546+0000", 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9295999999999999e-05 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.145569+0000", 2024-09-18T10:32:15.890 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.2697e-05 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.419040491000004, 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091240130000000003, 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 121 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394442+0000", 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394445+0000", 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.292e-06 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394448+0000", 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0819999999999999e-06 2024-09-18T10:32:15.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394450+0000", 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9420000000000002e-06 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399432+0000", 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0049813349999999999 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399474+0000", 2024-09-18T10:32:15.894 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2061000000000003e-05 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399540+0000", 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6324999999999999e-05 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403485+0000", 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0039450300000000004 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.895 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403519+0000", 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3794000000000002e-05 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403547+0000", 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8195999999999999e-05 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403566+0000", 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9236999999999999e-05 2024-09-18T10:32:15.896 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.419030002, 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0092440720000000007, 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.897 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 122 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394453+0000", 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.898 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394452+0000", 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394455+0000", 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.728e-06 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394460+0000", 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.1089999999999997e-06 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394463+0000", 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0939999999999999e-06 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399744+0000", 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052808059999999999 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399814+0000", 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.9710999999999997e-05 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.399928+0000", 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000113885 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403609+0000", 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0036813979999999998 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403616+0000", 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7390000000000002e-06 2024-09-18T10:32:15.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403658+0000", 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2373000000000002e-05 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403697+0000", 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.8435e-05 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.419007711000006, 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011099146000000001, 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 123 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.903 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394475+0000", 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394505+0000", 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.0673999999999998e-05 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394511+0000", 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5539999999999997e-06 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394513+0000", 2024-09-18T10:32:15.905 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.52e-06 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400185+0000", 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056715170000000001 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400227+0000", 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.2512999999999998e-05 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.906 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.400322+0000", 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.4887000000000001e-05 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403719+0000", 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0033967540000000001 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405497+0000", 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001778204 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.907 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405542+0000", 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4502000000000002e-05 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.405574+0000", 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2379000000000003e-05 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4206.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-18T10:32:15.908 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 72.418965555, 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.016509943999999999, 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4206", 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/297495683", 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 124 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:15.909 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394517+0000", 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.910 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394519+0000", 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.508e-06 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394522+0000", 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.83e-06 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.394524+0000", 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.804e-06 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403059+0000", 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0085345979999999991 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403129+0000", 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0043999999999995e-05 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for subops from 15", 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.403245+0000", 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000116123 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:15.912 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.404743+0000", 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.001498309 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op_commit", 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410948+0000", 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0062045370000000004 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.913 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.410993+0000", 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.5629e-05 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:03.411027+0000", 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.3827e-05 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s2 75/33 ECSubWrite(tid=114, reqid=osd.0.0:114, at_version=75'91, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.914 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.701184+0000", 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 16.112298150000001, 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010483292, 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701184+0000", 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701184+0000", 2024-09-18T10:32:15.915 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701183+0000", 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701211+0000", 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8085999999999998e-05 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701223+0000", 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1599e-05 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701230+0000", 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.849e-06 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701280+0000", 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.0614e-05 2024-09-18T10:32:15.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.701290+0000", 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5429999999999999e-06 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711641+0000", 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.010350546 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711668+0000", 2024-09-18T10:32:15.918 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7209e-05 2024-09-18T10:32:15.919 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.919 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.920 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.920 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.920 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.6s2 75/33 ECSubWrite(tid=115, reqid=client.4589.0:658, at_version=75'92, trim_to=0'0, roll_forward_to=73'87))", 2024-09-18T10:32:15.920 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:59.702490+0000", 2024-09-18T10:32:15.920 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 16.110993101999998, 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0091997079999999992, 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702490+0000", 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702490+0000", 2024-09-18T10:32:15.921 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.702489+0000", 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703378+0000", 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00088902700000000002 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.922 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703395+0000", 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.6888000000000002e-05 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.703402+0000", 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.3069999999999997e-06 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.704936+0000", 2024-09-18T10:32:15.923 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0015342859999999999 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.704946+0000", 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.798e-06 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711672+0000", 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0067261930000000001 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.924 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:59.711689+0000", 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7082999999999999e-05 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4589.0:718 3.8s0 3:15f078d6:::smithi16036501-48:head [append 0~606208] snapc 2e=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:06.615576+0000", 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.1979062319999993, 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0096284079999999998, 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.925 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4589", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 718 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.615576+0000", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.615576+0000", 2024-09-18T10:32:15.926 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.615570+0000", 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999933 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616881+0000", 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013116250000000001 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.927 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616900+0000", 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8938999999999999e-05 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616908+0000", 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.3990000000000004e-06 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616990+0000", 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.1346000000000003e-05 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.928 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "op must wait for map", 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.616998+0000", 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.4179999999999997e-06 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.617802+0000", 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000804012 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.617890+0000", 2024-09-18T10:32:15.929 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.7502000000000003e-05 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.619270+0000", 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0013801040000000001 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.622103+0000", 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0028329779999999999 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "commit_sent", 2024-09-18T10:32:15.930 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.625107+0000", 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0030046000000000001 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.625205+0000", 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.7381999999999997e-05 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "osd_op(client.4589.0:723 3.8s0 3:15f078d6:::smithi16036501-48:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-18T10:32:15.931 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 9.1870043100000007, 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.011891406, 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "started", 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "client_info": { 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "client": "client.4589", 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "tid": 723 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:15.932 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:15.933 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.933 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626478+0000", 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626481+0000", 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4680000000000001e-06 2024-09-18T10:32:15.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626488+0000", 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2709999999999998e-06 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.626491+0000", 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.7100000000000001e-06 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.628927+0000", 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0024354979999999999 2024-09-18T10:32:15.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.628986+0000", 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.9135000000000002e-05 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.634864+0000", 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.005877925 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "started", 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.634918+0000", 2024-09-18T10:32:15.936 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4101000000000003e-05 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:06.638370+0000", 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0034517570000000002 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:15.937 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:15.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:32:15.940 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:32:15.940 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:15.938+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:16.040 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:16.039+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:16.057 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:16.058 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:16.073 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:16.074 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:16.080 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:16.080 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:16.080 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:16.080 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:16.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:32:16.090 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:16.091 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:16.106 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:16.107 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:16.121 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:16.122 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:16.141 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:16.140+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:16.187 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:16.187 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:16.187 INFO:teuthology.orchestra.run.smithi100.stdout: "complaint_time": 30, 2024-09-18T10:32:16.187 INFO:teuthology.orchestra.run.smithi100.stdout: "num_blocked_ops": 0 2024-09-18T10:32:16.187 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:16.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:32:16.280 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:16.279+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:16.333 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "size": 20, 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 600, 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [ 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 44/33 ECSubWrite(tid=115, reqid=osd.4.0:115, at_version=44'30, trim_to=0'0, roll_forward_to=42'26))", 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.017330579000003, 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054360959999999996, 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314518+0000", 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314517+0000", 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314545+0000", 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7441e-05 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314558+0000", 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2716e-05 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314564+0000", 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7190000000000004e-06 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314614+0000", 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.9595000000000002e-05 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.314623+0000", 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.9889999999999998e-06 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319931+0000", 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053084439999999998 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319954+0000", 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3073000000000001e-05 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 44/33 ECSubWrite(tid=116, reqid=osd.4.0:112, at_version=0'0, trim_to=0'0, roll_forward_to=44'26))", 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.014354083999997, 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00557647, 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317495+0000", 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317494+0000", 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317507+0000", 2024-09-18T10:32:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3528e-05 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317522+0000", 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.45e-05 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317529+0000", 2024-09-18T10:32:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4619999999999999e-06 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317587+0000", 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7552000000000001e-05 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.317597+0000", 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8810000000000008e-06 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323054+0000", 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054572689999999998 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.323071+0000", 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7435000000000002e-05 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 44/33 ECSubWrite(tid=21, reqid=osd.8.0:21, at_version=44'12, trim_to=0'0, roll_forward_to=42'10))", 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 47.012580665000002, 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063338889999999997, 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319268+0000", 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319300+0000", 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1572000000000002e-05 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319313+0000", 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3832000000000001e-05 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319322+0000", 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.1419999999999999e-06 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319384+0000", 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1598000000000002e-05 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.319394+0000", 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.8079999999999999e-06 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325566+0000", 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006172192 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:29.325602+0000", 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.6075999999999998e-05 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=131, reqid=client.4589.0:302, at_version=45'24, trim_to=0'0, roll_forward_to=44'21))", 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 45.991010995000003, 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054953399999999996, 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:32:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340838+0000", 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.340837+0000", 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341640+0000", 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00080260699999999999 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341653+0000", 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3579e-05 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341665+0000", 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1549000000000001e-05 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341728+0000", 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2787999999999996e-05 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.341738+0000", 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0380000000000001e-05 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346306+0000", 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0045678009999999998 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346333+0000", 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7606999999999998e-05 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.352 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=132, reqid=client.4589.0:311, at_version=45'33, trim_to=0'0, roll_forward_to=44'30))", 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 45.988118907, 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006336899, 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.353 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343730+0000", 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.343729+0000", 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344271+0000", 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00054216699999999997 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344284+0000", 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2551999999999999e-05 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344290+0000", 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.5599999999999999e-06 2024-09-18T10:32:16.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344376+0000", 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.5834000000000005e-05 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.344387+0000", 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0942e-05 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.356 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350040+0000", 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056529889999999998 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.350067+0000", 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.6857999999999999e-05 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.357 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=133, reqid=client.4589.0:312, at_version=45'34, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 45.986519770000001, 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0074420069999999996, 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.358 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345329+0000", 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345328+0000", 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345430+0000", 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00010200399999999999 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.359 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345444+0000", 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3827e-05 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.345454+0000", 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.5219999999999996e-06 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346383+0000", 2024-09-18T10:32:16.360 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00092949799999999996 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346395+0000", 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1858999999999999e-05 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352753+0000", 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063576789999999998 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.361 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352771+0000", 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.8556999999999999e-05 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 45/33 ECSubWrite(tid=134, reqid=client.4589.0:313, at_version=45'35, trim_to=0'0, roll_forward_to=45'32))", 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 45.985372976000001, 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063042000000000003, 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346476+0000", 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.363 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346475+0000", 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346495+0000", 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9876000000000001e-05 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346507+0000", 2024-09-18T10:32:16.364 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2407e-05 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346514+0000", 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7220000000000002e-06 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346794+0000", 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00028027400000000001 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.365 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.346807+0000", 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2388999999999999e-05 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352774+0000", 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059673729999999998 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352780+0000", 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.1279999999999996e-06 2024-09-18T10:32:16.366 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 45/33 ECSubWrite(tid=135, reqid=client.4589.0:302, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 45.984637728000003, 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055314830000000002, 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:32:16.367 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347211+0000", 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347210+0000", 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.368 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347224+0000", 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3794e-05 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347239+0000", 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.5313000000000001e-05 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347246+0000", 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7700000000000004e-06 2024-09-18T10:32:16.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347295+0000", 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.8534e-05 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.347306+0000", 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1224e-05 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.370 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352720+0000", 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054135549999999996 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:30.352743+0000", 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.3156999999999999e-05 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:32:16.371 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.730743885999999, 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0053213160000000004, 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601105+0000", 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601104+0000", 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601311+0000", 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000206684 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.373 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601324+0000", 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3562e-05 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601330+0000", 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.3630000000000002e-06 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601373+0000", 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.3516000000000001e-05 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.374 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.601380+0000", 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.6109999999999999e-06 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606405+0000", 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0050246329999999997 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.606426+0000", 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1841e-05 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.375 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 41.729361384999997, 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064992319999999998, 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602488+0000", 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602487+0000", 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602544+0000", 2024-09-18T10:32:16.377 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.7605000000000002e-05 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602559+0000", 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4873e-05 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.602566+0000", 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.0180000000000004e-06 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.378 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603204+0000", 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00063799400000000002 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.603216+0000", 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1888e-05 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608951+0000", 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057352130000000003 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.379 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:34.608987+0000", 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.5417000000000003e-05 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=195, reqid=client.4589.0:427, at_version=55'49, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 36.662971980000002, 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0073182050000000004, 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.380 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.381 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.668877+0000", 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967296 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669388+0000", 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00051155899999999997 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669401+0000", 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2711000000000001e-05 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.382 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669409+0000", 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.6580000000000002e-06 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669465+0000", 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5994e-05 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.669472+0000", 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.695e-06 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.383 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676164+0000", 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0066911820000000004 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.676195+0000", 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.1532000000000002e-05 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.384 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/33 ECSubWrite(tid=196, reqid=client.4589.0:428, at_version=55'50, trim_to=0'0, roll_forward_to=53'47))", 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 36.658975177000002, 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0057749089999999999, 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.385 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672874+0000", 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.672873+0000", 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673445+0000", 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00057173499999999997 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673456+0000", 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.1579999999999999e-05 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673463+0000", 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.7320000000000001e-06 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673504+0000", 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.0636999999999997e-05 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.387 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.673516+0000", 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2187e-05 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678624+0000", 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0051085599999999998 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:39.678649+0000", 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4375999999999998e-05 2024-09-18T10:32:16.388 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/33 ECSubWrite(tid=55, reqid=osd.8.0:55, at_version=60'46, trim_to=0'0, roll_forward_to=59'44))", 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 31.727172824, 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0056724729999999999, 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.389 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604676+0000", 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.390 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604700+0000", 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4581999999999999e-05 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604710+0000", 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 9.2399999999999996e-06 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604715+0000", 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5910000000000003e-06 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.391 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604763+0000", 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.7939999999999998e-05 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.604774+0000", 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0698e-05 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610328+0000", 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0055546199999999997 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.392 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.610349+0000", 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.0162000000000001e-05 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.4s5 60/33 ECSubWrite(tid=57, reqid=osd.8.0:56, at_version=0'0, trim_to=0'0, roll_forward_to=60'48))", 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 31.714968728999999, 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064620900000000002, 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.393 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616880+0000", 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616879+0000", 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616892+0000", 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2843000000000001e-05 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616905+0000", 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3203e-05 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.395 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616911+0000", 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.0589999999999999e-06 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616965+0000", 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.4148999999999999e-05 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.616972+0000", 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2589999999999997e-06 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.396 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623313+0000", 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0063408750000000002 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623342+0000", 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.9731999999999999e-05 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.397 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 60/33 ECSubWrite(tid=246, reqid=osd.4.0:246, at_version=60'68, trim_to=0'0, roll_forward_to=60'66))", 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 31.714553106, 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0061440729999999999, 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.398 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617296+0000", 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617295+0000", 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617317+0000", 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.1696e-05 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617330+0000", 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3634e-05 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617337+0000", 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.2859999999999996e-06 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617382+0000", 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4.4780000000000002e-05 2024-09-18T10:32:16.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.617392+0000", 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0261999999999999e-05 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623413+0000", 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.006020928 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:44.623440+0000", 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7203e-05 2024-09-18T10:32:16.401 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=290, reqid=client.4589.0:563, at_version=71'78, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.615117+0000", 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 20.716732141000001, 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0067141670000000001, 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615117+0000", 2024-09-18T10:32:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615117+0000", 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615116+0000", 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.403 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615519+0000", 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000403559 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615534+0000", 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4299e-05 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615541+0000", 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2269999999999996e-06 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.404 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615806+0000", 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00026529499999999997 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.615816+0000", 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.0169e-05 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621802+0000", 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059857729999999998 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621831+0000", 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.8779e-05 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=291, reqid=client.4589.0:564, at_version=71'79, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.617188+0000", 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 20.714661208999999, 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.005762128, 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617188+0000", 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617188+0000", 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617187+0000", 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617413+0000", 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.00022624 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617430+0000", 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7024000000000002e-05 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617437+0000", 2024-09-18T10:32:16.408 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.2960000000000001e-06 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617490+0000", 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2914999999999997e-05 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.617503+0000", 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.2394e-05 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.409 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622916+0000", 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054133269999999999 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622950+0000", 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.4008999999999999e-05 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=292, reqid=client.4589.0:565, at_version=71'80, trim_to=0'0, roll_forward_to=64'76))", 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.621908+0000", 2024-09-18T10:32:16.410 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 20.709940453000002, 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0054666009999999998, 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621908+0000", 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621908+0000", 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.621907+0000", 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622019+0000", 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.000111227 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.412 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622038+0000", 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.9550000000000001e-05 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622046+0000", 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 7.4939999999999997e-06 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622101+0000", 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.5649000000000002e-05 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.622115+0000", 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.4124000000000001e-05 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.627347+0000", 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0052318119999999997 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.627375+0000", 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.7795000000000001e-05 2024-09-18T10:32:16.414 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.7s5 71/33 ECSubWrite(tid=295, reqid=client.4589.0:571, at_version=71'83, trim_to=0'0, roll_forward_to=71'79))", 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:31:55.632967+0000", 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 20.698882125000001, 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0059280369999999997, 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.415 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.632967+0000", 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.632967+0000", 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.416 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.632966+0000", 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635251+0000", 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.002284964 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635268+0000", 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.7082999999999999e-05 2024-09-18T10:32:16.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635275+0000", 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 6.8340000000000001e-06 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635327+0000", 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2040000000000003e-05 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.635335+0000", 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 8.2009999999999999e-06 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.638862+0000", 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0035274289999999999 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:31:55.638895+0000", 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 3.2580000000000003e-05 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.419 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "description": "MOSDECSubOpWrite(3.1s3 76/33 ECSubWrite(tid=356, reqid=client.4589.0:681, at_version=76'65, trim_to=0'0, roll_forward_to=76'62))", 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "initiated_at": "2024-09-18T10:32:00.715323+0000", 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "age": 15.616525702000001, 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0065391249999999998, 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "type_data": { 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "flag_point": "reached pg", 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "events": [ 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "initiated", 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715323+0000", 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "throttled", 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715323+0000", 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "header_read", 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715322+0000", 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 4294967295.999999 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "all_read", 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715343+0000", 2024-09-18T10:32:16.421 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.012e-05 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "dispatched", 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715356+0000", 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.3229e-05 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "queued_for_pg", 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715362+0000", 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.8080000000000001e-06 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "reached_pg", 2024-09-18T10:32:16.422 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715414+0000", 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 5.2711999999999999e-05 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_started", 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.715430+0000", 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 1.592e-05 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "sub_op_committed", 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721838+0000", 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 0.0064080719999999999 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-18T10:32:16.423 INFO:teuthology.orchestra.run.smithi100.stdout: "event": "done", 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: "time": "2024-09-18T10:32:00.721862+0000", 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: "duration": 2.4108999999999999e-05 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-18T10:32:16.424 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:16.425 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:16.426 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:16.426 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:16.427 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:32:16.427 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:16.427 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:16.428 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:16.428 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:16.428 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:16.428 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:16.429 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:16.429 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:16.429 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:16.430 INFO:teuthology.orchestra.run.smithi071.stdout:fsck success 2024-09-18T10:32:16.430 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:16.424+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:16.434 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:16.434 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:16.435 INFO:tasks.thrashosds.thrasher:resharding successfully completed 2024-09-18T10:32:16.435 INFO:tasks.thrashosds.thrasher:Reviving osd 9 2024-09-18T10:32:16.435 INFO:tasks.ceph.osd.9:Restarting daemon 2024-09-18T10:32:16.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-09-18T10:32:16.449 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:16.450 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:16.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:32:16.449+0000 7fbc6259c640 0 -- 172.21.15.63:0/3412696339 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7fbc64190670 msgr2=0x7fbc64192a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:32:16.477 INFO:tasks.ceph.osd.9:Started 2024-09-18T10:32:16.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:32:16.526 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:16.525+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:16.565 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:16.565 INFO:teuthology.orchestra.run.smithi100.stdout: "ops": [], 2024-09-18T10:32:16.565 INFO:teuthology.orchestra.run.smithi100.stdout: "num_ops": 0 2024-09-18T10:32:16.565 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:16.570 INFO:teuthology.orchestra.run.smithi071.stderr:no valid command found; 10 closest matches: 2024-09-18T10:32:16.570 INFO:teuthology.orchestra.run.smithi071.stderr:0 2024-09-18T10:32:16.570 INFO:teuthology.orchestra.run.smithi071.stderr:1 2024-09-18T10:32:16.570 INFO:teuthology.orchestra.run.smithi071.stderr:2 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:abort 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:assert 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:config diff 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:config diff get 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:config get 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:config help [] 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:config set ... 2024-09-18T10:32:16.571 INFO:teuthology.orchestra.run.smithi071.stderr:admin_socket: invalid command 2024-09-18T10:32:16.572 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-18T10:32:16.573 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-9, ['dump_ops_in_flight'] 2024-09-18T10:32:16.574 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:32:16.627 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:16.626+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:16.666 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:16.667 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:16.672 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:16.672 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:16.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:32:16.683 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:16.683 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:16.686 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:16.687 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:16.688 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:32:16.689 INFO:tasks.rados.rados.0.smithi160.stdout:344: done (3 left) 2024-09-18T10:32:16.689 INFO:tasks.rados.rados.0.smithi160.stdout:345: done (2 left) 2024-09-18T10:32:16.689 INFO:tasks.rados.rados.0.smithi160.stdout:346: done (1 left) 2024-09-18T10:32:16.689 INFO:tasks.rados.rados.0.smithi160.stdout:347: done (0 left) 2024-09-18T10:32:16.689 INFO:tasks.rados.rados.0.smithi160.stdout:348: copy_from oid 35 from oid 47 current snap is 30 2024-09-18T10:32:16.689 INFO:tasks.rados.rados.0.smithi160.stdout:349: setattr oid 50 current snap is 30 2024-09-18T10:32:16.690 INFO:tasks.rados.rados.0.smithi160.stdout:350: snap_create 2024-09-18T10:32:16.696 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 50 v 43 (ObjNum 137 snap 25 seq_num 137) dirty exists 2024-09-18T10:32:16.705 INFO:tasks.rados.rados.0.smithi160.stdout:348: finishing copy_from racing read to smithi16036501-35 2024-09-18T10:32:16.709 INFO:tasks.rados.rados.0.smithi160.stdout:348: finishing copy_from to smithi16036501-35 2024-09-18T10:32:16.709 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 35 v 9 (ObjNum 139 snap 25 seq_num 139) dirty exists 2024-09-18T10:32:16.729 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:16.727+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:16.779 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:16.780 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:16.788 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:32:16.829 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:16.828+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:16.896 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:16.896 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:16.904 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:32:16.930 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:16.929+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:17.003 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.003 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:32:17.055 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:17.054+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:17.063 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:17.061+0000 7feed3d0f440 -1 Falling back to public interface 2024-09-18T10:32:17.110 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.110 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:32:17.132 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:17.131+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:17.233 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:17.232+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:17.258 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.258 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.266 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:32:17.334 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:17.333+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:17.364 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.365 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.373 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:32:17.435 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:17.434+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:17.470 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.470 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.478 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:32:17.536 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:17.535+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:17.576 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.577 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:32:17.598 INFO:tasks.rados.rados.0.smithi160.stdout:348: done (2 left) 2024-09-18T10:32:17.598 INFO:tasks.rados.rados.0.smithi160.stdout:349: done (1 left) 2024-09-18T10:32:17.598 INFO:tasks.rados.rados.0.smithi160.stdout:350: done (0 left) 2024-09-18T10:32:17.598 INFO:tasks.rados.rados.0.smithi160.stdout:351: copy_from oid 43 from oid 5 current snap is 31 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:352: read oid 6 snap -1 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:352: expect (ObjNum 121 snap 20 seq_num 121) 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:353: rollback oid 8 current snap is 31 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 8 to 27 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:354: read oid 46 snap 27 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:354: expect (ObjNum 147 snap 26 seq_num 147) 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:355: read oid 48 snap -1 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:355: expect (ObjNum 128 snap 23 seq_num 128) 2024-09-18T10:32:17.599 INFO:tasks.rados.rados.0.smithi160.stdout:356: delete oid 14 current snap is 31 2024-09-18T10:32:17.609 INFO:tasks.rados.rados.0.smithi160.stdout:356: done (5 left) 2024-09-18T10:32:17.609 INFO:tasks.rados.rados.0.smithi160.stdout:357: copy_from oid 18 from oid 44 current snap is 31 2024-09-18T10:32:17.609 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 24 current snap is 31 2024-09-18T10:32:17.609 INFO:tasks.rados.rados.0.smithi160.stdout:358: seq_num 152 ranges {1261568=147456} 2024-09-18T10:32:17.617 INFO:tasks.rados.rados.0.smithi160.stdout:358: writing smithi16036501-24 from 1261568 to 1409024 tid 1 2024-09-18T10:32:17.617 INFO:tasks.rados.rados.0.smithi160.stdout:359: read oid 33 snap -1 2024-09-18T10:32:17.617 INFO:tasks.rados.rados.0.smithi160.stdout:359: expect deleted 2024-09-18T10:32:17.618 INFO:tasks.rados.rados.0.smithi160.stdout:360: snap_create 2024-09-18T10:32:17.620 INFO:tasks.rados.rados.0.smithi160.stdout:357: finishing copy_from racing read to smithi16036501-18 2024-09-18T10:32:17.621 INFO:tasks.rados.rados.0.smithi160.stdout:354: expect (ObjNum 147 snap 26 seq_num 147) 2024-09-18T10:32:17.637 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:17.635+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:17.695 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.695 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.704 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:357: finishing copy_from to smithi16036501-18 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 18 v 15 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:358: finishing write tid 1 to smithi16036501-24 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:358: finishing write tid 2 to smithi16036501-24 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:353: finishing rollback tid 0 to smithi16036501-8 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:353: finishing rollback tid 1 to smithi16036501-8 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:353: finishing rollback tid 2 to smithi16036501-8 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 8 v 115 (ObjNum 143 snap 26 seq_num 143) dirty exists 2024-09-18T10:32:17.716 INFO:tasks.rados.rados.0.smithi160.stdout:358: finishing write tid 3 to smithi16036501-24 2024-09-18T10:32:17.717 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 24 v 71 (ObjNum 152 snap 31 seq_num 152) dirty exists 2024-09-18T10:32:17.717 INFO:tasks.rados.rados.0.smithi160.stdout:358: left oid 24 (ObjNum 152 snap 31 seq_num 152) 2024-09-18T10:32:17.717 INFO:tasks.rados.rados.0.smithi160.stdout:352: expect (ObjNum 121 snap 20 seq_num 121) 2024-09-18T10:32:17.760 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:17.759+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:17.775 INFO:tasks.rados.rados.0.smithi160.stdout:351: finishing copy_from racing read to smithi16036501-43 2024-09-18T10:32:17.775 INFO:tasks.rados.rados.0.smithi160.stdout:355: expect (ObjNum 128 snap 23 seq_num 128) 2024-09-18T10:32:17.816 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.816 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.825 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:32:17.838 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:17.837+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:17.866 INFO:tasks.rados.rados.0.smithi160.stdout:351: finishing copy_from to smithi16036501-43 2024-09-18T10:32:17.866 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 43 v 64 (ObjNum 145 snap 26 seq_num 145) dirty exists 2024-09-18T10:32:17.939 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:17.938+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:17.963 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:17.963 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:17.972 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:32:18.039 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:18.038+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:18.069 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.069 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.078 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:32:18.140 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:18.139+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:18.175 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.175 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:32:18.241 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:18.240+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:18.299 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.299 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:32:18.341 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:18.341+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:18.443 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:18.442+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:18.452 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.452 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:32:18.545 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:18.543+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:18.563 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.563 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:32:18.600 INFO:tasks.rados.rados.0.smithi160.stdout:351: done (8 left) 2024-09-18T10:32:18.600 INFO:tasks.rados.rados.0.smithi160.stdout:352: done (7 left) 2024-09-18T10:32:18.600 INFO:tasks.rados.rados.0.smithi160.stdout:353: done (6 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:354: done (5 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:355: done (4 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:357: done (3 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:358: done (2 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:359: done (1 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:360: done (0 left) 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:361: rollback oid 2 current snap is 32 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 2 to 30 2024-09-18T10:32:18.601 INFO:tasks.rados.rados.0.smithi160.stdout:362: setattr oid 36 current snap is 32 2024-09-18T10:32:18.602 INFO:tasks.rados.rados.0.smithi160.stdout:363: copy_from oid 7 from oid 42 current snap is 32 2024-09-18T10:32:18.602 INFO:tasks.rados.rados.0.smithi160.stdout:364: read oid 30 snap -1 2024-09-18T10:32:18.602 INFO:tasks.rados.rados.0.smithi160.stdout:364: expect (ObjNum 146 snap 26 seq_num 146) 2024-09-18T10:32:18.602 INFO:tasks.rados.rados.0.smithi160.stdout:365: delete oid 46 current snap is 32 2024-09-18T10:32:18.606 INFO:tasks.rados.rados.0.smithi160.stdout:365: done (4 left) 2024-09-18T10:32:18.606 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 47 current snap is 32 2024-09-18T10:32:18.607 INFO:tasks.rados.rados.0.smithi160.stdout:366: seq_num 154 ranges {2342912=180224} 2024-09-18T10:32:18.620 INFO:tasks.rados.rados.0.smithi160.stdout:366: writing smithi16036501-47 from 2342912 to 2523136 tid 1 2024-09-18T10:32:18.621 INFO:tasks.rados.rados.0.smithi160.stdout:367: snap_create 2024-09-18T10:32:18.621 INFO:tasks.rados.rados.0.smithi160.stdout:361: finishing rollback tid 0 to smithi16036501-2 2024-09-18T10:32:18.621 INFO:tasks.rados.rados.0.smithi160.stdout:364: expect (ObjNum 146 snap 26 seq_num 146) 2024-09-18T10:32:18.643 INFO:tasks.rados.rados.0.smithi160.stdout:361: finishing rollback tid 1 to smithi16036501-2 2024-09-18T10:32:18.643 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 36 v 106 (ObjNum 118 snap 19 seq_num 118) dirty exists 2024-09-18T10:32:18.643 INFO:tasks.rados.rados.0.smithi160.stdout:361: finishing rollback tid 2 to smithi16036501-2 2024-09-18T10:32:18.644 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 2 v 32 (ObjNum 138 snap 25 seq_num 138) dirty exists 2024-09-18T10:32:18.644 INFO:tasks.rados.rados.0.smithi160.stdout:366: finishing write tid 1 to smithi16036501-47 2024-09-18T10:32:18.644 INFO:tasks.rados.rados.0.smithi160.stdout:366: finishing write tid 2 to smithi16036501-47 2024-09-18T10:32:18.644 INFO:tasks.rados.rados.0.smithi160.stdout:366: finishing write tid 3 to smithi16036501-47 2024-09-18T10:32:18.644 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 47 v 12 (ObjNum 154 snap 32 seq_num 154) dirty exists 2024-09-18T10:32:18.644 INFO:tasks.rados.rados.0.smithi160.stdout:366: left oid 47 (ObjNum 154 snap 32 seq_num 154) 2024-09-18T10:32:18.645 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:18.644+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:18.677 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.678 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:32:18.688 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:32:18.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-18T10:32:18.746 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:18.745+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:18.791 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:18.792 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:18.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:32:18.818 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:18.819 INFO:tasks.rados.rados.0.smithi160.stdout:363: finishing copy_from racing read to smithi16036501-7 2024-09-18T10:32:18.822 INFO:tasks.rados.rados.0.smithi160.stdout:363: finishing copy_from to smithi16036501-7 2024-09-18T10:32:18.823 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 7 v 15 (ObjNum 54 snap 0 seq_num 54) dirty exists 2024-09-18T10:32:18.846 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:18.847 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:18.847 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:18.846+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:18.867 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:18.868 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:18.887 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:18.902 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:18.903 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:18.910 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:302 3.1s0 3:8a576e44:::smithi16036501-20:head [copy-from ver 5] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.581609293, 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020457712999999999, 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.911 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 302 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326556+0000", 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326570+0000", 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3662999999999999e-05 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326585+0000", 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5468000000000002e-05 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326593+0000", 2024-09-18T10:32:18.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326667+0000", 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4306000000000003e-05 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1179999999999992e-06 2024-09-18T10:32:18.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328239+0000", 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015644680000000001 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328381+0000", 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014198999999999999 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340281+0000", 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011899197 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343588+0000", 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003307197 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346944+0000", 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033560090000000001 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347016+0000", 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:303 3.1s0 3:8a576e44:::smithi16036501-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.581560035000003, 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016629574000000001, 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 303 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326607+0000", 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326611+0000", 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0389999999999998e-06 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326620+0000", 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6039999999999999e-06 2024-09-18T10:32:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326630+0000", 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326734+0000", 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104131 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1168999999999999e-05 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328659+0000", 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018941400000000001 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5146999999999999e-05 2024-09-18T10:32:18.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343012+0000", 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014297432000000001 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343114+0000", 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010218 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343237+0000", 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123347 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:306 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.581455374000001, 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014939928, 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 306 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326715+0000", 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7330000000000001e-06 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326724+0000", 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326728+0000", 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0500000000000002e-06 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326892+0000", 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016359100000000001 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326897+0000", 2024-09-18T10:32:18.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5670000000000002e-06 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331380+0000", 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044830549999999997 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331488+0000", 2024-09-18T10:32:18.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108174 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341652+0000", 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163635000000001 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:311 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~622592] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.571099715000003, 2024-09-18T10:32:18.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266834, 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 311 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:18.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337066+0000", 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338892+0000", 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268259999999999 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338908+0000", 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5418999999999999e-05 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338972+0000", 2024-09-18T10:32:18.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4393000000000005e-05 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341761+0000", 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002788633 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341937+0000", 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017614900000000001 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343074+0000", 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001136698 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346619+0000", 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035453020000000002 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350277+0000", 2024-09-18T10:32:18.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036582979999999999 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350335+0000", 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.736e-05 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:312 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~147456] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:18.937 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.569182513000001, 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014117187999999999, 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 312 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:18.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338983+0000", 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339142+0000", 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015861599999999999 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339155+0000", 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2816000000000001e-05 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339164+0000", 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1749999999999994e-06 2024-09-18T10:32:18.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344524+0000", 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053596679999999997 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344614+0000", 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0613999999999997e-05 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345181+0000", 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056671599999999999 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346674+0000", 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00149266 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353034+0000", 2024-09-18T10:32:18.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063603460000000002 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353102+0000", 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8188000000000005e-05 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:313 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.943 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.568995821000001, 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014065207, 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 313 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339171+0000", 2024-09-18T10:32:18.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339175+0000", 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5129999999999998e-06 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339186+0000", 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339191+0000", 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1619999999999999e-06 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345694+0000", 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065030009999999996 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345792+0000", 2024-09-18T10:32:18.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8045000000000001e-05 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346298+0000", 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050656699999999998 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347147+0000", 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084835599999999998 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353189+0000", 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060422569999999997 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353237+0000", 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7890999999999999e-05 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:314 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 48.568970880999998, 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015236665999999999, 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 314 2024-09-18T10:32:18.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339196+0000", 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339199+0000", 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8890000000000002e-06 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339206+0000", 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339214+0000", 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1189999999999999e-06 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346686+0000", 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074727989999999996 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346756+0000", 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9511000000000006e-05 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353571+0000", 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068155439999999998 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353677+0000", 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010571 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.354433+0000", 2024-09-18T10:32:18.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075619700000000001 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:370 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~638976] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.312759638999999, 2024-09-18T10:32:18.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015060278, 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 370 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595405+0000", 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:18.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596396+0000", 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099055699999999998 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596414+0000", 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8655999999999999e-05 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596422+0000", 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596466+0000", 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4187000000000002e-05 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596471+0000", 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2310000000000004e-06 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598062+0000", 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015909850000000001 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598126+0000", 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4302999999999997e-05 2024-09-18T10:32:18.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598945+0000", 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081903900000000003 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610343+0000", 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011397243 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610417+0000", 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4027000000000001e-05 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610468+0000", 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1551999999999997e-05 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.963 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:371 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~622592] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.309202747, 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013192463, 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 371 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598963+0000", 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599585+0000", 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000621708 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599601+0000", 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512e-05 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599608+0000", 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599960+0000", 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035244900000000001 2024-09-18T10:32:18.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600065+0000", 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010497600000000001 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600996+0000", 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00093031500000000003 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612013+0000", 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011017020000000001 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612082+0000", 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8853e-05 2024-09-18T10:32:18.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612157+0000", 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5618999999999995e-05 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:372 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~147456] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.308535067000001, 2024-09-18T10:32:18.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012685169, 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 372 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.971 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599631+0000", 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599752+0000", 2024-09-18T10:32:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121066 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599766+0000", 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3681e-05 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599774+0000", 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7810000000000005e-06 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601741+0000", 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019676609999999999 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601868+0000", 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012701100000000001 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602485+0000", 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061702700000000003 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612162+0000", 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096771410000000002 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612277+0000", 2024-09-18T10:32:18.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114471 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612318+0000", 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0738000000000002e-05 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:374 3.bs0 3:d059b4f5:::smithi16036501-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:18.977 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.308368225999999, 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014050109, 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 374 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:18.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599802+0000", 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9550000000000001e-06 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599808+0000", 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9689999999999999e-06 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599811+0000", 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6370000000000001e-06 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603965+0000", 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041538549999999997 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:18.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.604070+0000", 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104654 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612750+0000", 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086806729999999999 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612839+0000", 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8678999999999996e-05 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.613849+0000", 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010102519999999999 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:449 3.7s0 3:e76b4e45:::smithi16036501-14:head [append 0~0] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.180837238000002, 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013587101000000001, 2024-09-18T10:32:18.983 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 449 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727334+0000", 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727340+0000", 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6790000000000002e-06 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727349+0000", 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5289999999999997e-06 2024-09-18T10:32:18.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737235+0000", 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098852860000000001 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737349+0000", 2024-09-18T10:32:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114485 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737818+0000", 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046887099999999999 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739481+0000", 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016627129999999999 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740836+0000", 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013552600000000001 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740917+0000", 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1295e-05 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:490 3.1s0 3:86a5dc0f:::smithi16036501-49:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.312470318999999, 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012816803999999999, 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 490 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595700+0000", 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.568e-06 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595707+0000", 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5860000000000001e-06 2024-09-18T10:32:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595711+0000", 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9720000000000003e-06 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595822+0000", 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110819 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595830+0000", 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6910000000000003e-06 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600152+0000", 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043221630000000004 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600254+0000", 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101945 2024-09-18T10:32:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600730+0000", 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047567799999999999 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603018+0000", 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002287472 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608447+0000", 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054292159999999997 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608514+0000", 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7257999999999999e-05 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:565 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~704512] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.288591513, 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014747458999999999, 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 565 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619575+0000", 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620250+0000", 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00067491600000000001 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620264+0000", 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4566000000000001e-05 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620271+0000", 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1820000000000003e-06 2024-09-18T10:32:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620306+0000", 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5108999999999999e-05 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620382+0000", 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6019999999999994e-05 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.621150+0000", 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076778700000000003 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623627+0000", 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024771849999999998 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634275+0000", 2024-09-18T10:32:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010647927999999999 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634323+0000", 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8860000000000003e-05 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:566 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (57) in=7b] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.287886725, 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014199358, 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 566 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620280+0000", 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620284+0000", 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1570000000000002e-06 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620291+0000", 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7989999999999996e-06 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620296+0000", 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3839999999999996e-06 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.621913+0000", 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001616742 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622023+0000", 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109658 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622442+0000", 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041913699999999998 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.624407+0000", 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019650779999999999 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634418+0000", 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010010968 2024-09-18T10:32:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634480+0000", 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2088999999999995e-05 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:567 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.287857582000001, 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016946042000000001, 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 567 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620309+0000", 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620312+0000", 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-06 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620319+0000", 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.844e-06 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620323+0000", 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0180000000000003e-06 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622648+0000", 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002325063 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:19.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622738+0000", 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0117000000000005e-05 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634507+0000", 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011768548 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634560+0000", 2024-09-18T10:32:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2877000000000002e-05 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.637256+0000", 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026962980000000002 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:571 3.7s0 3:e6324555:::smithi16036501-16:head [copy-from ver 70] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.287839013999999, 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018763179000000001, 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 571 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.019 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620328+0000", 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620334+0000", 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.75e-06 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620340+0000", 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.511e-06 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620344+0000", 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9750000000000001e-06 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622803+0000", 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024588019999999999 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622893+0000", 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9523000000000003e-05 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.023 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.632430+0000", 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095375430000000008 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634814+0000", 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023841840000000001 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.639038+0000", 2024-09-18T10:32:19.024 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042237439999999998 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.639092+0000", 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3718000000000003e-05 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.025 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:572 3.7s0 3:e6324555:::smithi16036501-16:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.287818852000001, 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013844128000000001, 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 572 2024-09-18T10:32:19.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:19.027 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620348+0000", 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620351+0000", 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.356e-06 2024-09-18T10:32:19.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620357+0000", 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8810000000000001e-06 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620360+0000", 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7450000000000001e-06 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623121+0000", 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027608300000000001 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623171+0000", 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0099999999999998e-05 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.030 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.633947+0000", 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010775389 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634061+0000", 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011421600000000001 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634193+0000", 2024-09-18T10:32:19.031 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013202 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:883 3.7s0 3:e21b4941:::smithi16036501-31:head [copy-from ver 95] snapc 38=[38,37,36] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:15.682897+0000", 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.2252705970000002, 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020542469000000001, 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:19.032 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682897+0000", 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.033 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682897+0000", 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682894+0000", 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682914+0000", 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9772999999999999e-05 2024-09-18T10:32:19.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682939+0000", 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5380000000000001e-05 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682950+0000", 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1096e-05 2024-09-18T10:32:19.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683017+0000", 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7136000000000002e-05 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683025+0000", 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0039999999999999e-06 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.036 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685096+0000", 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020712230000000001 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685213+0000", 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011642900000000001 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.037 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.697865+0000", 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012651674999999999 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.702574+0000", 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047091049999999999 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:19.038 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.703392+0000", 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081801400000000005 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.703439+0000", 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7695999999999999e-05 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.039 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:884 3.7s0 3:e21b4941:::smithi16036501-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e91)", 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:15.682964+0000", 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 3.2252033760000001, 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017140368999999999, 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 884 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.040 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682964+0000", 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682964+0000", 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.041 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682963+0000", 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682968+0000", 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1500000000000001e-06 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.042 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682980+0000", 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2666e-05 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682986+0000", 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4500000000000003e-06 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683090+0000", 2024-09-18T10:32:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010375 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683100+0000", 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0042e-05 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685377+0000", 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022777969999999998 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.044 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685444+0000", 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6843999999999999e-05 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.699864+0000", 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014419390000000001 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.045 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.699963+0000", 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9487999999999993e-05 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.700105+0000", 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014145999999999999 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.047 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.047 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.047 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:19.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:32:19.049 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:19.050 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:19.050 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:19.051 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:19.051 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:19.052 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:19.052 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:19.052 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:19.053 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:19.053 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:19.053 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:19.053 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:19.054 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:19.054 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:19.054 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:19.055 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:19.047+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:19.060 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:19.060 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:19.063 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:19.064 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:19.149 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:19.148+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:19.162 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:19.162 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:19.162 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:19.162 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:19.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:32:19.250 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:19.249+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:19.271 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:19.271 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:19.271 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:19.271 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:19.271 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:19.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:32:19.351 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:19.349+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:366 3.4s0 3:2e7558df:::smithi16036501-5:head [delete] snapc d=[d,b,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:19.383 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.787937829000001, 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095772340000000004, 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 366 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593485+0000", 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593493+0000", 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9000000000000006e-06 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593511+0000", 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8011000000000001e-05 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593517+0000", 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.781e-06 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593607+0000", 2024-09-18T10:32:19.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9117999999999996e-05 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593636+0000", 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9022000000000001e-05 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594774+0000", 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001138376 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594884+0000", 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110449 2024-09-18T10:32:19.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595595+0000", 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00071014400000000001 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.598115+0000", 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0025207670000000001 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602981+0000", 2024-09-18T10:32:19.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048657020000000004 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.603064+0000", 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2763999999999996e-05 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:367 3.4s0 3:22c8281c:::smithi16036501-32:head [create,setxattr nWX_d[W\\dXUWOgbXndrSbcTU`mgjR_]o\\nNcXpin (1403) in=40b,setxattr TSP[ddnm_WR]nh]QhSXpkpmmWeOP^b]baemT^Uqr (630) in=40b,setxattr R[QU^NWYrjfarmhlWmZlUkP\\ipWan`SnqZOX`VWh (806) in=40b,setxattr ]hV\\^[PQZO]n^abhilRfldoUhgtl\\\\oel`mgahd_ (3368) in=40b,setxattr OYc`XQ\\VjZfQ`]OsbemUo_mfVUSc^pNo\\[\\ldrhg (1087) in=40b,setxattr `pZtTmno_eqZOONfatgZ_`nnhemaaQWiteO]dc[V (175) in=40b,setxattr PdQa`feQapkrnjfOUYUeqsOt_hrsg\\noqrcV]pSh (981) in=40b,setxattr bk_QpaSsdlQfT`oa[pTQS_[ad]isfYm^tQNdhSiW (1718) in=40b,setxattr Ys`Y_UZ^PXhpgS`VS]`eVgkcmT^QW[aWscssRRSr (10033) in=40b,setxattr [jd]Q\\qemWTVcc`hiZnsrqrggetajZRa]\\_llS`h (1367) in=40b,setxattr `UajoeZh]tRSf\\[nnVat^TjN^_q`ooQ_br`itgZm (244) in=40b,setxattr Tng[WcWa_dsnRXtZNa^`fle`gQ___mar\\fgRsZVY (665) in=40b,setxattr nogmhepVZfQtnZc^cZSeaaogjklZkrff_Utg`UR^ (15856) in=40b,setxattr gfqSsQY[][rrac[gmaQrTSacNWttTTXhanmRa^fa (1998) in=40b,setxattr V`Y[ddb`_dfep[_]oUoTqQj\\UW[gkesnlgNPYtPa (1438) in=40b,setxattr YgoRVqUOj_mXPXsq^PdjaaolmQsTsTsZpaddktl[ (1400) in=40b,setxattr smn[QVPVkfVs]oTip]jtirOtU\\Pa\\Ym^poZgfZaq (1263) in=40b,setxattr TQSmSs^Z]\\rdosO_a^TOU^[p`jkQb`dXXh]s`Stq (909) in=40b,setxattr faPhpqVXmWh`VeNZo[b^[kYl^[[rYYPRrk_[ON`e (14664) in=40b,setxattr ksO_UmqqQefe[Q\\njt[W_roWeei`]Sn^TV]O^iSW (1963) in=40b] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:19.389 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.775288772000003, 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068636369999999997, 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:19.390 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 367 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606134+0000", 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606259+0000", 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012537799999999999 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606277+0000", 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7677e-05 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606284+0000", 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1629999999999999e-06 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606326+0000", 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1956000000000003e-05 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606462+0000", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136422 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607463+0000", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010009730000000001 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.609207+0000", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017437399999999999 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:19.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612922+0000", 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003715281 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612999+0000", 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6951000000000002e-05 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:32:19.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.774474284, 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048843690000000004, 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606950+0000", 2024-09-18T10:32:19.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606949+0000", 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606978+0000", 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9088e-05 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606991+0000", 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.254e-05 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606997+0000", 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1489999999999999e-06 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608218+0000", 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001220687 2024-09-18T10:32:19.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.608228+0000", 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0509999999999999e-05 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611809+0000", 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035805440000000002 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611834+0000", 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5670999999999999e-05 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.654855443000002, 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049878819999999999, 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726569+0000", 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726568+0000", 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.401 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726971+0000", 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040273199999999999 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727008+0000", 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7058999999999999e-05 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727018+0000", 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4960000000000002e-06 2024-09-18T10:32:19.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727105+0000", 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7641999999999999e-05 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727116+0000", 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0288e-05 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731541+0000", 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044253809999999999 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731557+0000", 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5767e-05 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:19.404 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.652538526000001, 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063305380000000001, 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:19.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728885+0000", 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728993+0000", 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108399 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.406 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729010+0000", 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6674999999999999e-05 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729017+0000", 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4760000000000001e-06 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729076+0000", 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8768999999999999e-05 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729087+0000", 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0370999999999999e-05 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735190+0000", 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061034770000000004 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735216+0000", 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6321000000000001e-05 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.651776847000001, 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075128, 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729647+0000", 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729962+0000", 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031509799999999998 2024-09-18T10:32:19.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729974+0000", 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2442999999999999e-05 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729985+0000", 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0778000000000001e-05 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730933+0000", 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094732900000000001 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730946+0000", 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2981e-05 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737129+0000", 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061833449999999998 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.412 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737160+0000", 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1452000000000003e-05 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.650560468000002, 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063226910000000001, 2024-09-18T10:32:19.413 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730879+0000", 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6008e-05 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730889+0000", 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6860000000000001e-06 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730894+0000", 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6339999999999998e-06 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731351+0000", 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000456577 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731360+0000", 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0520000000000007e-06 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737174+0000", 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058143250000000004 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737187+0000", 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2310000000000001e-05 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.738210651999999, 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056619699999999997, 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.418 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643213+0000", 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643236+0000", 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3031999999999999e-05 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.419 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643245+0000", 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6619999999999994e-06 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643251+0000", 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8529999999999997e-06 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643299+0000", 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7874000000000003e-05 2024-09-18T10:32:19.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643308+0000", 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4390000000000006e-06 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648839+0000", 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055302210000000001 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648876+0000", 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7181999999999997e-05 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 56/33 ECSubWrite(tid=83, reqid=osd.5.0:83, at_version=56'37, trim_to=0'0, roll_forward_to=55'35))", 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.735155581999997, 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047824060000000003, 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646269+0000", 2024-09-18T10:32:19.423 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646292+0000", 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3662000000000001e-05 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646306+0000", 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3517e-05 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.424 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646316+0000", 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8239999999999995e-06 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646393+0000", 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7268999999999995e-05 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646403+0000", 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0475999999999999e-05 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.425 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651027+0000", 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004623963 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651051+0000", 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3972e-05 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.426 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:32:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 38.734771000999999, 2024-09-18T10:32:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066185949999999997, 2024-09-18T10:32:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.428 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646674+0000", 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1492e-05 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646686+0000", 2024-09-18T10:32:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1752e-05 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646692+0000", 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0260000000000004e-06 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646751+0000", 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9382000000000002e-05 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.430 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646762+0000", 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1042e-05 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653246+0000", 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064839570000000003 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653272+0000", 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5605999999999998e-05 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.431 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=95, reqid=client.4589.0:487, at_version=60'41, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.780223147999997, 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.009354111, 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601216+0000", 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5795e-05 2024-09-18T10:32:19.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601228+0000", 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1372999999999999e-05 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601234+0000", 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.178e-06 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601802+0000", 2024-09-18T10:32:19.434 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056782999999999996 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601812+0000", 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.027e-05 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610535+0000", 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087234549999999998 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.435 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610555+0000", 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=96, reqid=osd.5.0:96, at_version=60'43, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.779361768000001, 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085102259999999992, 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.436 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.437 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602062+0000", 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602086+0000", 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.393e-05 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602098+0000", 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1949e-05 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.438 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602104+0000", 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3740000000000003e-06 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602590+0000", 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048540399999999999 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602599+0000", 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2029999999999998e-06 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.439 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610562+0000", 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079633459999999996 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610573+0000", 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0791000000000001e-05 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.440 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.778387504000001, 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067723929999999998, 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603070+0000", 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2941999999999997e-05 2024-09-18T10:32:19.442 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603082+0000", 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2391e-05 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603088+0000", 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3280000000000002e-06 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603148+0000", 2024-09-18T10:32:19.443 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0093000000000002e-05 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603159+0000", 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0217999999999999e-05 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609781+0000", 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066224500000000002 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.444 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609809+0000", 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8194000000000001e-05 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=97, reqid=osd.5.0:97, at_version=60'45, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.776941987000001, 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061409799999999999, 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.446 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604503+0000", 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1679e-05 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604516+0000", 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2172e-05 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604522+0000", 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2430000000000002e-06 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604689+0000", 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166928 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604699+0000", 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0586e-05 2024-09-18T10:32:19.448 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610607+0000", 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059073229999999999 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610623+0000", 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6792000000000001e-05 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.449 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 34.770062887999998, 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058420499999999997, 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.450 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611361+0000", 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611370+0000", 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1959999999999997e-06 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.451 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611381+0000", 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1175000000000001e-05 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611386+0000", 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6059999999999996e-06 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611448+0000", 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1869e-05 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.452 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611457+0000", 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6609999999999995e-06 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617180+0000", 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057225189999999997 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617204+0000", 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3652e-05 2024-09-18T10:32:19.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 33.779772571999999, 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004305578, 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.454 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601652+0000", 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601777+0000", 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012559 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601798+0000", 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1138999999999999e-05 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601809+0000", 2024-09-18T10:32:19.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1069e-05 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601881+0000", 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2056000000000003e-05 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.601892+0000", 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0804e-05 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605917+0000", 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0040245489999999997 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605957+0000", 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0605999999999997e-05 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 76/33 ECSubWrite(tid=123, reqid=osd.5.0:123, at_version=76'65, trim_to=0'0, roll_forward_to=75'63))", 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:00.698957+0000", 2024-09-18T10:32:19.458 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.682467731999999, 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050509930000000001, 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698957+0000", 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698957+0000", 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698956+0000", 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698980+0000", 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.425e-05 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.698996+0000", 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5675000000000002e-05 2024-09-18T10:32:19.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.699004+0000", 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.554e-06 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.699074+0000", 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0403999999999999e-05 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.699085+0000", 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1555e-05 2024-09-18T10:32:19.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.703976+0000", 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048903879999999999 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704008+0000", 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1786999999999999e-05 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 76/33 ECSubWrite(tid=124, reqid=osd.5.0:123, at_version=0'0, trim_to=0'0, roll_forward_to=76'65))", 2024-09-18T10:32:19.462 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:00.704379+0000", 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.677044995999999, 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055344549999999998, 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704379+0000", 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704379+0000", 2024-09-18T10:32:19.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704378+0000", 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704391+0000", 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2644e-05 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704419+0000", 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7798e-05 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704426+0000", 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0010000000000004e-06 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704477+0000", 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0766000000000001e-05 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.704488+0000", 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1351e-05 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.709877+0000", 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053894370000000004 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:00.709914+0000", 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6557000000000003e-05 2024-09-18T10:32:19.466 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es4 85/33 ECSubWrite(tid=55, reqid=osd.11.0:54, at_version=0'0, trim_to=0'0, roll_forward_to=85'39))", 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:09.619644+0000", 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7617808339999996, 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041278139999999996, 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619644+0000", 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619644+0000", 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619643+0000", 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619654+0000", 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1078e-05 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619665+0000", 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0781000000000001e-05 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619672+0000", 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8140000000000003e-06 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619755+0000", 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3404000000000003e-05 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.619765+0000", 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.005e-05 2024-09-18T10:32:19.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.623720+0000", 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039549989999999998 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.623771+0000", 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1205999999999997e-05 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 85/77 ECSubWrite(tid=220, reqid=osd.13.0:218, at_version=0'0, trim_to=0'0, roll_forward_to=85'26))", 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:09.624333+0000", 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.7570913109999999, 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044256729999999998, 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624333+0000", 2024-09-18T10:32:19.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624333+0000", 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624332+0000", 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624344+0000", 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1277000000000001e-05 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624359+0000", 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5339999999999999e-05 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624366+0000", 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624421+0000", 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4920000000000003e-05 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.624434+0000", 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3010000000000001e-05 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.628734+0000", 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042992289999999999 2024-09-18T10:32:19.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:09.628759+0000", 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5255000000000001e-05 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.476 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:19.477 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:19.464+0000 7feed3d0f440 -1 bluestore::NCB::__restore_allocator::No Valid allocation info on disk (empty file) 2024-09-18T10:32:19.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:32:19.478 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:19.477+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:19.578 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:19.577+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:19.601 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-18T10:32:19.602 INFO:tasks.rados.rados.0.smithi160.stdout:361: done (5 left) 2024-09-18T10:32:19.603 INFO:tasks.rados.rados.0.smithi160.stdout:362: done (4 left) 2024-09-18T10:32:19.603 INFO:tasks.rados.rados.0.smithi160.stdout:363: done (3 left) 2024-09-18T10:32:19.603 INFO:tasks.rados.rados.0.smithi160.stdout:364: done (2 left) 2024-09-18T10:32:19.603 INFO:tasks.rados.rados.0.smithi160.stdout:366: done (1 left) 2024-09-18T10:32:19.603 INFO:tasks.rados.rados.0.smithi160.stdout:367: done (0 left) 2024-09-18T10:32:19.603 INFO:tasks.rados.rados.0.smithi160.stdout:368: setattr oid 12 current snap is 33 2024-09-18T10:32:19.604 INFO:tasks.rados.rados.0.smithi160.stdout:369: rollback oid 40 current snap is 33 2024-09-18T10:32:19.604 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 40 to 29 2024-09-18T10:32:19.604 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 10 current snap is 33 2024-09-18T10:32:19.604 INFO:tasks.rados.rados.0.smithi160.stdout:370: seq_num 155 ranges {3342336=212992} 2024-09-18T10:32:19.621 INFO:tasks.rados.rados.0.smithi160.stdout:370: writing smithi16036501-10 from 3342336 to 3555328 tid 1 2024-09-18T10:32:19.621 INFO:tasks.rados.rados.0.smithi160.stdout:371: snap_remove snap 27 2024-09-18T10:32:19.631 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:19.631 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:19.631 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:19.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:32:19.680 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:19.679+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:19.781 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:19.780+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:19.782 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:19.782 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:19.782 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:19.782 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:19.782 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:19.791 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:32:19.882 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:19.880+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=63, reqid=osd.5.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:19.894 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.294292614, 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045952509999999998, 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597804+0000", 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597803+0000", 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597814+0000", 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1413999999999999e-05 2024-09-18T10:32:19.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597824+0000", 2024-09-18T10:32:19.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6989999999999998e-06 2024-09-18T10:32:19.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597830+0000", 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9839999999999998e-06 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597886+0000", 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6334e-05 2024-09-18T10:32:19.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.597895+0000", 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5599999999999994e-06 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602372+0000", 2024-09-18T10:32:19.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044773520000000004 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602399+0000", 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6472e-05 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/33 ECSubWrite(tid=64, reqid=client.4589.0:368, at_version=49'26, trim_to=0'0, roll_forward_to=49'24))", 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:32:19.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.285106466999999, 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047167229999999999, 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606990+0000", 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606989+0000", 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607014+0000", 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4873999999999999e-05 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607029+0000", 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5136e-05 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607036+0000", 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7340000000000002e-06 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607236+0000", 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020045800000000001 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607246+0000", 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.009e-05 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611683+0000", 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044365819999999997 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611706+0000", 2024-09-18T10:32:19.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3509000000000001e-05 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.285034531000001, 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046098479999999997, 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.905 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607062+0000", 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607061+0000", 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607083+0000", 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1835999999999999e-05 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607093+0000", 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9049999999999992e-06 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607100+0000", 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2450000000000001e-06 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607147+0000", 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7092999999999998e-05 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607154+0000", 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5799999999999997e-06 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611645+0000", 2024-09-18T10:32:19.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044915099999999998 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.611671+0000", 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6421999999999999e-05 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.290762201, 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010486074, 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601333+0000", 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601448+0000", 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115426 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601462+0000", 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3579e-05 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601469+0000", 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0530000000000001e-06 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601650+0000", 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000181273 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601659+0000", 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3739999999999998e-06 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611795+0000", 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010135877999999999 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611820+0000", 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5400000000000001e-05 2024-09-18T10:32:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.289491456, 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095436749999999997, 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602604+0000", 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602653+0000", 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8948e-05 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602666+0000", 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2779000000000001e-05 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602674+0000", 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3210000000000005e-06 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602759+0000", 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5636999999999993e-05 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602770+0000", 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0465000000000001e-05 2024-09-18T10:32:19.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612126+0000", 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093557369999999994 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612148+0000", 2024-09-18T10:32:19.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2736000000000001e-05 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.288334065999997, 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084016750000000008, 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603761+0000", 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603784+0000", 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2696000000000001e-05 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603798+0000", 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4199000000000001e-05 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603805+0000", 2024-09-18T10:32:19.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6200000000000001e-06 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603872+0000", 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7512e-05 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603883+0000", 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729e-05 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612153+0000", 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082698349999999997 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.078e-05 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.925 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.165155644000002, 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065126710000000003, 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726940+0000", 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727360+0000", 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041924799999999999 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727372+0000", 2024-09-18T10:32:19.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2152e-05 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727379+0000", 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8730000000000001e-06 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727436+0000", 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7802e-05 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727446+0000", 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2520000000000005e-06 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733427+0000", 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059812659999999998 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733453+0000", 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6302e-05 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.163110549000002, 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075586109999999998, 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728985+0000", 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729148+0000", 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016313100000000001 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729165+0000", 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7489000000000001e-05 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729182+0000", 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6079999999999999e-05 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729230+0000", 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8004000000000003e-05 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729240+0000", 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0327e-05 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736514+0000", 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072737649999999997 2024-09-18T10:32:19.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736544+0000", 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0602000000000003e-05 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.161068434000001, 2024-09-18T10:32:19.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055584830000000003, 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731027+0000", 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731125+0000", 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8250000000000003e-05 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731138+0000", 2024-09-18T10:32:19.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3022e-05 2024-09-18T10:32:19.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731146+0000", 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.571e-06 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731229+0000", 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3368999999999994e-05 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731239+0000", 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5880000000000004e-06 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736576+0000", 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053372209999999996 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736586+0000", 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0389e-05 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.160935793, 2024-09-18T10:32:19.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054374030000000004, 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:19.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731178+0000", 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8043999999999999e-05 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731187+0000", 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0189999999999995e-06 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731193+0000", 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6169999999999998e-06 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731650+0000", 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045705799999999999 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731659+0000", 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4630000000000007e-06 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736588+0000", 2024-09-18T10:32:19.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004929124 2024-09-18T10:32:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736598+0000", 2024-09-18T10:32:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5089999999999999e-06 2024-09-18T10:32:19.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.948 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=212, reqid=osd.4.0:212, at_version=56'57, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:19.949 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:19.949 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.252334955999999, 2024-09-18T10:32:19.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046823120000000001, 2024-09-18T10:32:19.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.949 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:19.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:19.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639761+0000", 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639788+0000", 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6826999999999999e-05 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639799+0000", 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1231e-05 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639805+0000", 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6290000000000004e-06 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639867+0000", 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1551999999999996e-05 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.639877+0000", 2024-09-18T10:32:19.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0308e-05 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644419+0000", 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045418610000000003 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644444+0000", 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4377999999999999e-05 2024-09-18T10:32:19.955 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=215, reqid=client.4589.0:459, at_version=56'59, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.248649733000001, 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048391809999999997, 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643445+0000", 2024-09-18T10:32:19.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643467+0000", 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1481e-05 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643482+0000", 2024-09-18T10:32:19.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4612e-05 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643490+0000", 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2150000000000001e-06 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643544+0000", 2024-09-18T10:32:19.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4302000000000003e-05 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643556+0000", 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2136999999999999e-05 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648259+0000", 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047024700000000003 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648286+0000", 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6923999999999998e-05 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=216, reqid=client.4589.0:460, at_version=56'60, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.248335001000001, 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045387350000000003, 2024-09-18T10:32:19.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643761+0000", 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643788+0000", 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7053e-05 2024-09-18T10:32:19.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643797+0000", 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5810000000000003e-06 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643803+0000", 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6590000000000004e-06 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644611+0000", 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080760000000000001 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644619+0000", 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7770000000000008e-06 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648290+0000", 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003670539 2024-09-18T10:32:19.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648300+0000", 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9699999999999994e-06 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.245396646000003, 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045182080000000001, 2024-09-18T10:32:19.966 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646700+0000", 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646699+0000", 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646718+0000", 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9131999999999999e-05 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646728+0000", 2024-09-18T10:32:19.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4690000000000003e-06 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646733+0000", 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5550000000000002e-06 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646780+0000", 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6839000000000003e-05 2024-09-18T10:32:19.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646789+0000", 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1449999999999997e-06 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651195+0000", 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044061660000000004 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.651218+0000", 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2518999999999999e-05 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=92, reqid=client.4589.0:485, at_version=60'39, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.294131751000002, 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041052750000000002, 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.971 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597964+0000", 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.597989+0000", 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5136000000000001e-05 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598002+0000", 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2218999999999999e-05 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598008+0000", 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8430000000000004e-06 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598070+0000", 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1849999999999999e-05 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.598082+0000", 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602043+0000", 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039603920000000001 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602070+0000", 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7098999999999999e-05 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.975 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=93, reqid=client.4589.0:486, at_version=60'40, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.292786616999997, 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046809249999999998, 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599310+0000", 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599309+0000", 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599330+0000", 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1630000000000001e-05 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599366+0000", 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5364000000000002e-05 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599374+0000", 2024-09-18T10:32:19.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1799999999999996e-06 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599422+0000", 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7868000000000003e-05 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.599432+0000", 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8409999999999995e-06 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603965+0000", 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045336689999999997 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603990+0000", 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5258000000000001e-05 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 35.280726682000001, 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051192939999999999, 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611380+0000", 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611392+0000", 2024-09-18T10:32:19.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611399+0000", 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1130000000000003e-06 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611450+0000", 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0590000000000002e-05 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611461+0000", 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0616e-05 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616457+0000", 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049963660000000003 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616489+0000", 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1863999999999998e-05 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 65/33 ECSubWrite(tid=107, reqid=client.4589.0:543, at_version=65'52, trim_to=0'0, roll_forward_to=64'51))", 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.230579601999999, 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047841719999999997, 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.986 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661516+0000", 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662367+0000", 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000850492 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662384+0000", 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6991e-05 2024-09-18T10:32:19.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662391+0000", 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1709999999999996e-06 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662450+0000", 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8943999999999997e-05 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662462+0000", 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2033e-05 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666279+0000", 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038165149999999999 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666301+0000", 2024-09-18T10:32:19.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 71/33 ECSubWrite(tid=306, reqid=client.4589.0:587, at_version=71'95, trim_to=0'0, roll_forward_to=71'93))", 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 24.195701531000001, 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047899739999999998, 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696394+0000", 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696497+0000", 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103317 2024-09-18T10:32:19.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696511+0000", 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4279e-05 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696524+0000", 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2311e-05 2024-09-18T10:32:19.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696574+0000", 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0018999999999997e-05 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696580+0000", 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3419999999999996e-06 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.701169+0000", 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045889149999999998 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.701185+0000", 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5775999999999999e-05 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:19.996 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 86/77 ECSubWrite(tid=147, reqid=client.4589.0:824, at_version=86'39, trim_to=0'0, roll_forward_to=83'37))", 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:10.623208+0000", 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.2688884569999992, 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005238454, 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623208+0000", 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623208+0000", 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:19.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623207+0000", 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623699+0000", 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049184100000000002 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623710+0000", 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1581e-05 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:19.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623717+0000", 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0299999999999996e-06 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.624211+0000", 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049357700000000003 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.624223+0000", 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1758e-05 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:20.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.628416+0000", 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041928399999999998 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.628446+0000", 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0502999999999999e-05 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:20.001 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:20.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:32:20.004 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:20.002+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:20.104 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:20.104 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:20.104 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:20.103+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:20.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:32:20.205 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:20.204+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:20.208 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:20.208 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:20.208 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:20.208 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:20.208 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:20.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:32:20.228 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:20.227+0000 7feed3d0f440 -1 bluestore::NCB::__restore_allocator::No Valid allocation info on disk (empty file) 2024-09-18T10:32:20.306 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:20.305+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:20.353 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=7, reqid=osd.14.0:7, at_version=40'6, trim_to=0'0, roll_forward_to=39'4))", 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.021375450000001, 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024793150000000002, 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293785+0000", 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293784+0000", 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293834+0000", 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9882000000000001e-05 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293848+0000", 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3913e-05 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293857+0000", 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:32:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293910+0000", 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2933999999999998e-05 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.293919+0000", 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3440000000000007e-06 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296229+0000", 2024-09-18T10:32:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023091040000000002 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.296264+0000", 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5673999999999998e-05 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 40/33 ECSubWrite(tid=65, reqid=osd.13.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=40'15))", 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.016590137999998, 2024-09-18T10:32:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025004430000000002, 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298570+0000", 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298569+0000", 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298587+0000", 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7978999999999998e-05 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298607+0000", 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9627e-05 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298628+0000", 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1246e-05 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298695+0000", 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7471999999999994e-05 2024-09-18T10:32:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298707+0000", 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1379000000000001e-05 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301022+0000", 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00231526 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.301071+0000", 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8744e-05 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.2s3 40/33 ECSubWrite(tid=8, reqid=osd.14.0:7, at_version=0'0, trim_to=0'0, roll_forward_to=40'6))", 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.016265578000002, 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049479429999999998, 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298895+0000", 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298894+0000", 2024-09-18T10:32:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298909+0000", 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4646e-05 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298921+0000", 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2830000000000001e-05 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298942+0000", 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0462000000000002e-05 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.298993+0000", 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0968999999999999e-05 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.299001+0000", 2024-09-18T10:32:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1319999999999994e-06 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303821+0000", 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048198410000000001 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:25.303843+0000", 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1846000000000001e-05 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 45/33 ECSubWrite(tid=79, reqid=client.4589.0:295, at_version=45'24, trim_to=0'0, roll_forward_to=44'22))", 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.990857228000003, 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052771249999999997, 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324303+0000", 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324448+0000", 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014492199999999999 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324465+0000", 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6928000000000001e-05 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324473+0000", 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4290000000000001e-06 2024-09-18T10:32:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324536+0000", 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3182000000000006e-05 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324547+0000", 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0407999999999999e-05 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329548+0000", 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050016779999999999 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329580+0000", 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1859000000000001e-05 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 45/33 ECSubWrite(tid=80, reqid=client.4589.0:295, at_version=0'0, trim_to=0'0, roll_forward_to=45'24))", 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.982686790999999, 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002518607, 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332474+0000", 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332473+0000", 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332485+0000", 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2669e-05 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332500+0000", 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.472e-05 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332508+0000", 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6480000000000003e-06 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332567+0000", 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9750999999999998e-05 2024-09-18T10:32:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332577+0000", 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7070000000000004e-06 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.334961+0000", 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023839180000000001 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.334992+0000", 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1109000000000003e-05 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 49/33 ECSubWrite(tid=172, reqid=osd.4.0:172, at_version=49'41, trim_to=0'0, roll_forward_to=48'37))", 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.708117948000002, 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023816800000000002, 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607042+0000", 2024-09-18T10:32:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607066+0000", 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4323000000000001e-05 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607084+0000", 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7872000000000001e-05 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607091+0000", 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2239999999999998e-06 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607153+0000", 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1663999999999998e-05 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607163+0000", 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8989999999999996e-06 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.609402+0000", 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022393780000000002 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.609424+0000", 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 56/33 ECSubWrite(tid=213, reqid=client.4589.0:458, at_version=56'58, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.673850106000003, 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028836209999999998, 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641310+0000", 2024-09-18T10:32:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641309+0000", 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641330+0000", 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0845000000000001e-05 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641581+0000", 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025098500000000001 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641589+0000", 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5650000000000004e-06 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641637+0000", 2024-09-18T10:32:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8804999999999998e-05 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.641647+0000", 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5259999999999999e-06 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644164+0000", 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002517437 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.644194+0000", 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9390000000000002e-05 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "pg_update_log_missing(3.as1 epoch 56/33 rep_tid 121 entries 56'31 (0'0) error 3:52d3343a:::smithi16036501-18:head by client.4589.0:461 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 49'28)", 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.672521035000003, 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024779099999999998, 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642639+0000", 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642654+0000", 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4662e-05 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642672+0000", 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8542999999999998e-05 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642696+0000", 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3676000000000002e-05 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642783+0000", 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7560999999999997e-05 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645117+0000", 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023339139999999999 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.672441221, 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00237638, 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642719+0000", 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642739+0000", 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0530000000000002e-05 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642762+0000", 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2841999999999999e-05 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642770+0000", 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5920000000000003e-06 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642820+0000", 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0701000000000001e-05 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642830+0000", 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0086e-05 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645068+0000", 2024-09-18T10:32:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022371769999999999 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645095+0000", 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7883000000000001e-05 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 56/33 ECSubWrite(tid=125, reqid=osd.13.0:125, at_version=56'33, trim_to=0'0, roll_forward_to=53'30))", 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.660371582000003, 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062986129999999998, 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654789+0000", 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654788+0000", 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654813+0000", 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5276999999999999e-05 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654829+0000", 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5387999999999999e-05 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654835+0000", 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8990000000000004e-06 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654888+0000", 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3004999999999998e-05 2024-09-18T10:32:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.654900+0000", 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.661062+0000", 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061620340000000003 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.661087+0000", 2024-09-18T10:32:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789999999999999e-05 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.713122380999998, 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030576539999999999, 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602038+0000", 2024-09-18T10:32:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602066+0000", 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8413000000000001e-05 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602076+0000", 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0227000000000001e-05 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602083+0000", 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.331e-06 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602173+0000", 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9917e-05 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602183+0000", 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893000000000001e-05 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605062+0000", 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028786240000000002 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605096+0000", 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3578000000000003e-05 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=237, reqid=osd.4.0:237, at_version=60'72, trim_to=0'0, roll_forward_to=59'70))", 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.712405138000001, 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002715496, 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602755+0000", 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602779+0000", 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4559e-05 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602792+0000", 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2183e-05 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602798+0000", 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5379999999999999e-06 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602861+0000", 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3260000000000001e-05 2024-09-18T10:32:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.602876+0000", 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.464e-05 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605441+0000", 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025647399999999998 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605471+0000", 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.989e-05 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=242, reqid=osd.4.0:239, at_version=0'0, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.703910471999997, 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663030000000001, 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611250+0000", 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611249+0000", 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611263+0000", 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3712e-05 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611278+0000", 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5489e-05 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611286+0000", 2024-09-18T10:32:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4390000000000003e-06 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611354+0000", 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8612e-05 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.611374+0000", 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9670999999999999e-05 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614397+0000", 2024-09-18T10:32:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030227909999999999 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.614416+0000", 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9406999999999999e-05 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=243, reqid=osd.4.0:243, at_version=60'76, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.702583189999999, 2024-09-18T10:32:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043321790000000002, 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612577+0000", 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612576+0000", 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612598+0000", 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2039999999999999e-05 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612610+0000", 2024-09-18T10:32:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1712999999999999e-05 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612615+0000", 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9219999999999996e-06 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612676+0000", 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0674000000000002e-05 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.612688+0000", 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2687000000000001e-05 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616881+0000", 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041925180000000001 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.616909+0000", 2024-09-18T10:32:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8391999999999999e-05 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/33 ECSubWrite(tid=244, reqid=osd.4.0:244, at_version=60'78, trim_to=0'0, roll_forward_to=60'74))", 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.701493876000001, 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061258190000000002, 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613666+0000", 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613685+0000", 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9247000000000001e-05 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613696+0000", 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1361e-05 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613701+0000", 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0030000000000002e-06 2024-09-18T10:32:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613740+0000", 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9100000000000002e-05 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.613764+0000", 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3413000000000001e-05 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619771+0000", 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060067280000000002 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.619792+0000", 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1707000000000001e-05 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 61/33 ECSubWrite(tid=140, reqid=client.4589.0:495, at_version=61'12, trim_to=0'0, roll_forward_to=60'10))", 2024-09-18T10:32:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.713569026000002, 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026074700000000002, 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601591+0000", 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601684+0000", 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2781999999999994e-05 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601697+0000", 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601704+0000", 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.754e-06 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601779+0000", 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4917000000000001e-05 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601791+0000", 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2808e-05 2024-09-18T10:32:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604162+0000", 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023708620000000001 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604199+0000", 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6424000000000002e-05 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as1 85/33 ECSubWrite(tid=217, reqid=osd.13.0:217, at_version=85'49, trim_to=0'0, roll_forward_to=84'47))", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.697231183, 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036460580000000002, 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617929+0000", 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617949+0000", 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0370999999999999e-05 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617963+0000", 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4341999999999999e-05 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.617970+0000", 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5880000000000003e-06 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618027+0000", 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7055999999999997e-05 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618044+0000", 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6974e-05 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.621551+0000", 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035064800000000002 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.621575+0000", 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4651000000000002e-05 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.ds1 85/77 ECSubWrite(tid=218, reqid=osd.13.0:218, at_version=85'26, trim_to=0'0, roll_forward_to=84'24))", 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.696559114999999, 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003463069, 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618601+0000", 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618627+0000", 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5891999999999999e-05 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618637+0000", 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0445000000000001e-05 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618645+0000", 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0399999999999993e-06 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618695+0000", 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9654000000000003e-05 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.618706+0000", 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0954999999999999e-05 2024-09-18T10:32:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.622044+0000", 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033382709999999999 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.622064+0000", 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0384999999999999e-05 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 85/77 ECSubWrite(tid=149, reqid=osd.3.0:149, at_version=85'107, trim_to=0'0, roll_forward_to=84'105))", 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.69581908, 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039359169999999997, 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619341+0000", 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619360+0000", 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9145000000000001e-05 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619371+0000", 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1124999999999999e-05 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619379+0000", 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9659999999999996e-06 2024-09-18T10:32:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619427+0000", 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7911999999999998e-05 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619438+0000", 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0380000000000001e-05 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623252+0000", 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038148990000000001 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623277+0000", 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4752e-05 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.0s2 85/77 ECSubWrite(tid=150, reqid=osd.3.0:150, at_version=85'109, trim_to=0'0, roll_forward_to=84'105))", 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:09.619530+0000", 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.695630762, 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044605699999999996, 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619530+0000", 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619530+0000", 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619529+0000", 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619552+0000", 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3611000000000001e-05 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619565+0000", 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2648e-05 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.619575+0000", 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5240000000000006e-06 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.621993+0000", 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024186339999999998 2024-09-18T10:32:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.622003+0000", 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7399999999999999e-06 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623969+0000", 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019658290000000001 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:09.623990+0000", 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1282000000000001e-05 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.445 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:20.445 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:32:20.447 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:20.446+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:20.527 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:20.525+0000 7feed3d0f440 -1 osd.9 73 log_to_monitors true 2024-09-18T10:32:20.548 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:20.547+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:20.551 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:20.551 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:20.551 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:20.551 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:20.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:32:20.604 INFO:tasks.rados.rados.0.smithi160.stdout:371: done (3 left) 2024-09-18T10:32:20.604 INFO:tasks.rados.rados.0.smithi160.stdout:372: read oid 42 snap -1 2024-09-18T10:32:20.604 INFO:tasks.rados.rados.0.smithi160.stdout:372: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:32:20.604 INFO:tasks.rados.rados.0.smithi160.stdout:373: rmattr oid 5 current snap is 33 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:373: done (4 left) 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:374: delete oid 3 current snap is 33 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:369: finishing rollback tid 0 to smithi16036501-40 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:369: finishing rollback tid 1 to smithi16036501-40 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:369: finishing rollback tid 2 to smithi16036501-40 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 40 v 58 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 12 v 78 (ObjNum 125 snap 20 seq_num 125) dirty exists 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:370: finishing write tid 1 to smithi16036501-10 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:370: finishing write tid 2 to smithi16036501-10 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:370: finishing write tid 3 to smithi16036501-10 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 10 v 109 (ObjNum 155 snap 33 seq_num 155) dirty exists 2024-09-18T10:32:20.605 INFO:tasks.rados.rados.0.smithi160.stdout:370: left oid 10 (ObjNum 155 snap 33 seq_num 155) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:368: done (4 left) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:369: done (3 left) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:370: done (2 left) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:374: done (1 left) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:375: read oid 7 snap 28 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:375: expect (ObjNum 122 snap 20 seq_num 122) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:376: read oid 44 snap -1 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:376: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:32:20.616 INFO:tasks.rados.rados.0.smithi160.stdout:377: snap_remove snap 31 2024-09-18T10:32:20.619 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:20.618+0000 7feecbdf0640 -1 osd.9 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T10:32:20.650 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:20.648+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:20.668 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:20.668 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:20.668 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:20.668 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:20.669 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:20.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:32:20.751 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:20.749+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:20.776 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:20.776 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:20.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:20.776 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:436 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~770048] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.051770408000003, 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011429902, 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 436 2024-09-18T10:32:20.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722229+0000", 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.722227+0000", 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723088+0000", 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086064300000000002 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723103+0000", 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5194000000000001e-05 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723126+0000", 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3286e-05 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723184+0000", 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8409000000000003e-05 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.723195+0000", 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0127e-05 2024-09-18T10:32:20.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725088+0000", 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932479999999999 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725155+0000", 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7061e-05 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.726518+0000", 2024-09-18T10:32:20.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001363076 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730117+0000", 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003598778 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733596+0000", 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034793699999999999 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.733659+0000", 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2459999999999995e-05 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:437 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~475136] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.048629652000002, 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013490482, 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 437 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725369+0000", 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725368+0000", 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725831+0000", 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046283199999999999 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725844+0000", 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3121e-05 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.725851+0000", 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.674e-06 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727646+0000", 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017952199999999999 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727719+0000", 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3166999999999999e-05 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728450+0000", 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073089599999999998 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730201+0000", 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001750564 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738806+0000", 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008605171 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738860+0000", 2024-09-18T10:32:20.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4008999999999997e-05 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:438 3.5s0 3:ac3be3d0:::smithi16036501-3:head [append 0~294912] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.046905252000002, 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01193583, 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 438 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727094+0000", 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727093+0000", 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727437+0000", 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00034437500000000001 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727451+0000", 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4089e-05 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727463+0000", 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2179e-05 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.728987+0000", 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015242299999999999 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729057+0000", 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9201000000000004e-05 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.729526+0000", 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046947999999999998 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731168+0000", 2024-09-18T10:32:20.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016422959999999999 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.738978+0000", 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078093099999999999 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739030+0000", 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1910999999999998e-05 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:439 3.5s0 3:ac3be3d0:::smithi16036501-3:head [setxattr _header (56) in=7b] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.046527517999998, 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011721551, 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 439 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.795 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727472+0000", 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727471+0000", 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727476+0000", 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1399999999999999e-06 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727485+0000", 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4590000000000004e-06 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727492+0000", 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4450000000000001e-06 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730312+0000", 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028200730000000002 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730376+0000", 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3989e-05 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730729+0000", 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353099 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731679+0000", 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00095002300000000003 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739133+0000", 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074541119999999997 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739193+0000", 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0016000000000003e-05 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:440 3.5s0 3:ac3be3d0:::smithi16036501-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:20.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.046499986999997, 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013207774, 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 440 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727499+0000", 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727503+0000", 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2220000000000004e-06 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727512+0000", 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1789999999999997e-06 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.727521+0000", 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9139999999999997e-06 2024-09-18T10:32:20.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.730982+0000", 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003461357 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.731094+0000", 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011191700000000001 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739479+0000", 2024-09-18T10:32:20.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083848180000000005 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.739571+0000", 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1942999999999997e-05 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:39.740707+0000", 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011359429999999999 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:456 3.5s0 3:ac3be3d0:::smithi16036501-3:head [copy-from ver 4] snapc 13=[d,6] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.133748490999999, 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01601, 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 456 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.806 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640251+0000", 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640248+0000", 2024-09-18T10:32:20.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640263+0000", 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4487e-05 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640282+0000", 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9524000000000001e-05 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640289+0000", 2024-09-18T10:32:20.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5939999999999999e-06 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640358+0000", 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9294000000000004e-05 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640367+0000", 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0170000000000002e-06 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645378+0000", 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050108269999999998 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645496+0000", 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000118449 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.649412+0000", 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039156800000000004 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650429+0000", 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00101706 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656201+0000", 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057721049999999996 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.656261+0000", 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9450999999999997e-05 2024-09-18T10:32:20.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:457 3.5s0 3:ac3be3d0:::smithi16036501-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.133694304000002, 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099350510000000003, 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 457 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640305+0000", 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640304+0000", 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640308+0000", 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.631e-06 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640315+0000", 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4590000000000001e-06 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640319+0000", 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.721e-06 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640554+0000", 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000235047 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640562+0000", 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1110000000000008e-06 2024-09-18T10:32:20.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645694+0000", 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051315149999999997 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.645744+0000", 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0756e-05 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650099+0000", 2024-09-18T10:32:20.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043545509999999999 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650157+0000", 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8363999999999999e-05 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650240+0000", 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2596000000000007e-05 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:485 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.178605732000001, 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092164380000000004, 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 485 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595393+0000", 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595391+0000", 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595401+0000", 2024-09-18T10:32:20.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559999999999994e-06 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595421+0000", 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.052e-05 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595430+0000", 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8149999999999995e-06 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595492+0000", 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2297000000000003e-05 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0696999999999999e-05 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597238+0000", 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017347510000000001 2024-09-18T10:32:20.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597314+0000", 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5784000000000005e-05 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.597920+0000", 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060640599999999998 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600840+0000", 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029203670000000001 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604512+0000", 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036712759999999998 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604610+0000", 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8109000000000005e-05 2024-09-18T10:32:20.824 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:486 3.cs0 3:3616aa10:::smithi16036501-19:head [rollback 17] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.178521070999999, 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095267909999999997, 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.825 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 486 2024-09-18T10:32:20.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.826 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:32:20.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595478+0000", 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595477+0000", 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595482+0000", 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9559999999999996e-06 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595489+0000", 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.866e-06 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595493+0000", 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4630000000000001e-06 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595574+0000", 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1390999999999994e-05 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595580+0000", 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2330000000000003e-06 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598599+0000", 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003018813 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.598675+0000", 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6198000000000005e-05 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.599265+0000", 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058946400000000005 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604855+0000", 2024-09-18T10:32:20.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055906949999999997 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.604930+0000", 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5139e-05 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605005+0000", 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4320000000000007e-05 2024-09-18T10:32:20.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:487 3.cs0 3:3616aa10:::smithi16036501-19:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.178500927000002, 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015332254999999999, 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 487 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595498+0000", 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967296 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595500+0000", 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7999999999999999e-06 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595503+0000", 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3380000000000001e-06 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595505+0000", 2024-09-18T10:32:20.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2419999999999999e-06 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595603+0000", 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7980999999999996e-05 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.595610+0000", 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5710000000000003e-06 2024-09-18T10:32:20.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600005+0000", 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043948529999999998 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600140+0000", 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135184 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.600625+0000", 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048546199999999998 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.605009+0000", 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043837019999999997 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610750+0000", 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057406339999999997 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:44.610830+0000", 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0711999999999996e-05 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:543 3.cs0 3:33d93753:::smithi16036501-12:head [copy-from ver 35] snapc 1e=[1e] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.120585942999998, 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013133835, 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 543 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653413+0000", 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653412+0000", 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653419+0000", 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.525e-06 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653431+0000", 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024999999999999e-05 2024-09-18T10:32:20.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653436+0000", 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1070000000000004e-06 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653469+0000", 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3037000000000002e-05 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653533+0000", 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3468999999999998e-05 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.661263+0000", 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007729774 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662684+0000", 2024-09-18T10:32:20.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014210920000000001 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.666504+0000", 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003820164 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.666547+0000", 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3142000000000001e-05 2024-09-18T10:32:20.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:544 3.cs0 3:33d93753:::smithi16036501-12:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.120556826000001, 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089048649999999997, 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 544 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:20.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653442+0000", 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653444+0000", 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7179999999999999e-06 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653448+0000", 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9020000000000001e-06 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653450+0000", 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2680000000000001e-06 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653638+0000", 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018801700000000001 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.653671+0000", 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3623e-05 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662159+0000", 2024-09-18T10:32:20.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084872190000000007 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662242+0000", 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2961999999999996e-05 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:49.662347+0000", 2024-09-18T10:32:20.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010546499999999999 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:691 3.cs0 3:33d93753:::smithi16036501-12:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.048861925000001, 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090110829999999996, 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:20.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725137+0000", 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725140+0000", 2024-09-18T10:32:20.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6959999999999998e-06 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725147+0000", 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6120000000000004e-06 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.725151+0000", 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8199999999999998e-06 2024-09-18T10:32:20.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.730361+0000", 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052106000000000001 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.730413+0000", 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1345999999999999e-05 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.731457+0000", 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001043867 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.731545+0000", 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8509000000000002e-05 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:00.734148+0000", 2024-09-18T10:32:20.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026031330000000001 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:824 3.5s0 3:a1445e23:::smithi16036501-34:head [append 0~425984] snapc 33=[33,30] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:10.619561+0000", 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.154438179, 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090713410000000001, 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 824 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.619561+0000", 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.619561+0000", 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.619557+0000", 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999967 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620248+0000", 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069106400000000002 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620274+0000", 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5282e-05 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620285+0000", 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0889e-05 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620345+0000", 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9988999999999998e-05 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.620351+0000", 2024-09-18T10:32:20.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4899999999999997e-06 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.622203+0000", 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001852013 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.622264+0000", 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1173000000000005e-05 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.622864+0000", 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060004100000000005 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.623773+0000", 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090852800000000003 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.628586+0000", 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048133890000000004 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.628632+0000", 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5952999999999999e-05 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:874 3.5s0 3:a1445e23:::smithi16036501-34:head [setxattr _header (57) in=7b] snapc 37=[37,36] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:14.648098+0000", 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.1259012290000001, 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01014147, 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 874 2024-09-18T10:32:20.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648098+0000", 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648098+0000", 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648097+0000", 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648101+0000", 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1450000000000001e-06 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648108+0000", 2024-09-18T10:32:20.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3550000000000001e-06 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648112+0000", 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1570000000000002e-06 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648186+0000", 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3583000000000003e-05 2024-09-18T10:32:20.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648190+0000", 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4669999999999998e-06 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.651914+0000", 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037236589999999998 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.652007+0000", 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3727999999999994e-05 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.652426+0000", 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000419083 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.652997+0000", 2024-09-18T10:32:20.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000570993 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.658173+0000", 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051752719999999999 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.658239+0000", 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6554e-05 2024-09-18T10:32:20.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:875 3.5s0 3:a1445e23:::smithi16036501-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e90)", 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:14.648123+0000", 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.1258755499999999, 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011212931000000001, 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 875 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648123+0000", 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648123+0000", 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648123+0000", 2024-09-18T10:32:20.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648126+0000", 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8150000000000002e-06 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648133+0000", 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1840000000000002e-06 2024-09-18T10:32:20.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648137+0000", 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.89e-06 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648203+0000", 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6118999999999995e-05 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.648206+0000", 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2760000000000001e-06 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.652637+0000", 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044309459999999998 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:20.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.652699+0000", 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2113999999999995e-05 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.658502+0000", 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058020809999999997 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.658597+0000", 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5316999999999996e-05 2024-09-18T10:32:20.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:14.659336+0000", 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00073958900000000002 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:931 3.cs0 3:33d93753:::smithi16036501-12:head [create,setxattr iUTOfla_ssccP]\\_gj\\fabTjOYfpZZ`[lQti\\_mT (210) in=40b,setxattr \\X]kpbSpisYfNir\\PgqOVbTn_kpRpfYajqZk`[og (1507) in=40b,setxattr Saa^gfgURRePecnindpQrjV]riqegqnhtUUSQs_f (137) in=40b,setxattr qPnPNagaTSf^qPgsmreVisViUWellO]YmanPp`Yj (1437) in=40b,setxattr ]odXlmhh]N\\pN`[f^Taljn\\a]iZqfRWnbqs]qils (1401) in=40b,setxattr Utdde_NgkR`hsROo`]PRajie (1085) in=24b,setxattr YNSpZ\\ednqefts\\rYmdOiUP_XZ[YYaa_atankka\\ (489) in=40b,setxattr YgZdONlX^UodVpon_]jSOreabbeSc[qoNdcY[sbq (1226) in=40b,setxattr PdNSTpShYUVaVcrd_ReNYgUeRhn[`pfaRYsbX[ZS (595) in=40b,setxattr WXfn\\eqrPNreXPtk_\\VcXVY_`Vo\\hVqrQYmrsqaj (10104) in=40b,setxattr ^ihUgT`[Vhi\\pmkNqj\\]YofiXpOd (1085) in=28b,setxattr ]i^atbZqinq]fO^k[X`hmseYtTrNPejSQcg]jNgl (698) in=40b,setxattr totZ]^s[ZVVphaqqZc]Rc`PksRi\\sS[sm]\\_otab (1083) in=40b,setxattr oOZPccRVs_]imdNSfSN\\j\\sZgoNb\\mqNWomVagia (769) in=40b,setxattr m`OqrTeo[qhZfjoNlVfhPXdZgZe]kNb`tQm\\\\Vcb (10104) in=40b,setxattr ^lTcpnaZQrWboRYafi\\OV_\\Skhibekh[lPaftYS` (1999) in=40b,setxattr OajRqQQc_P[eq`ZYPbnSXahVa^^hdc]_ReWtWl[S (243) in=40b,setxattr [VhdtiTZqf_jWsQ (1085) in=15b,setxattr n]cd]pUcP\\cS^Sid[ditgi\\UpeVaVTUYtqestZ`j (1155) in=40b,setxattr kXiYhocNNQ[iTktsjQtkZjadRVVXYc\\a[UseQ`c` (1259) in=40b] snapc 3c=[3c,3b,3a,39,38,37,36] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:19.602127+0000", 2024-09-18T10:32:20.883 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.171871656, 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089928590000000006, 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602127+0000", 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602127+0000", 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602125+0000", 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:20.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602250+0000", 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012436899999999999 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602270+0000", 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0630999999999999e-05 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602280+0000", 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0156000000000001e-05 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602333+0000", 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2664999999999998e-05 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602338+0000", 2024-09-18T10:32:20.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3349999999999997e-06 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.605027+0000", 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026887080000000002 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.605157+0000", 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012952999999999999 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.606323+0000", 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011664659999999999 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.607768+0000", 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014447290000000001 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.611051+0000", 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032832540000000002 2024-09-18T10:32:20.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.611120+0000", 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9255e-05 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:942 3.5s0 3:ac3be3d0:::smithi16036501-3:head [stat,delete] snapc 3c=[3c,3b,3a,39,38,36] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:20.604235+0000", 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.16976387700000001, 2024-09-18T10:32:20.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010736572, 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 942 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604235+0000", 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604235+0000", 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604233+0000", 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604246+0000", 2024-09-18T10:32:20.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2717999999999999e-05 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604281+0000", 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4891999999999997e-05 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604288+0000", 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7469999999999999e-06 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604330+0000", 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2518000000000002e-05 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604452+0000", 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012142900000000001 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.614972+0000", 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010520153000000001 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.6s4 96/77 ECSubWrite(tid=168, reqid=osd.0.0:168, at_version=96'121, trim_to=0'0, roll_forward_to=93'117))", 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:20.609405+0000", 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.16459364100000001, 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011833237, 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.898 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609405+0000", 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609405+0000", 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609405+0000", 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609428+0000", 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3025999999999999e-05 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609443+0000", 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5906e-05 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609450+0000", 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1850000000000001e-06 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.611813+0000", 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002362917 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.611821+0000", 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5040000000000002e-06 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.621216+0000", 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093952740000000003 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.621239+0000", 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2297999999999999e-05 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDECSubOpWrite(3.as3 96/33 ECSubWrite(tid=250, reqid=osd.13.0:250, at_version=96'62, trim_to=0'0, roll_forward_to=95'58))", 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:20.609917+0000", 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.16408204800000001, 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011294528, 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:20.903 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609917+0000", 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609917+0000", 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:20.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609917+0000", 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609940+0000", 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3711e-05 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609948+0000", 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1189999999999997e-06 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609956+0000", 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.452e-06 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.611876+0000", 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019204389999999999 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.611885+0000", 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2099999999999993e-06 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.621181+0000", 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092969309999999996 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.621212+0000", 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0046999999999999e-05 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:20.907 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:20.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:32:20.909 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:20.908+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:21.007 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:21.007 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:21.009 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:21.008+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:21.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:32:21.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:32:21.110 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:21.109+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:21.112 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:21.112 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:21.112 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:21.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:32:21.198 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:21.211 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:21.210+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:21.215 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:32:21.221 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.033856415000002, 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.349076098, 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185098+0000", 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185093+0000", 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999952 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185102+0000", 2024-09-18T10:32:21.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1079999999999999e-06 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185111+0000", 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4130000000000006e-06 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185116+0000", 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0080000000000002e-06 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185151+0000", 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5216000000000003e-05 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.185156+0000", 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5090000000000001e-06 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534040+0000", 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.34888328099999999 2024-09-18T10:32:21.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:05.534174+0000", 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134129 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4356.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 74.033942353, 2024-09-18T10:32:21.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010537852, 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4356", 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.63:0/660238527", 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 7 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185012+0000", 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185009+0000", 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185021+0000", 2024-09-18T10:32:21.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2024e-05 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185062+0000", 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0363e-05 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185072+0000", 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0712e-05 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185133+0000", 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0458999999999998e-05 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.185140+0000", 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1720000000000001e-06 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190251+0000", 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051104840000000002 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190319+0000", 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8640999999999996e-05 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 12", 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.190422+0000", 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102576 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.191693+0000", 2024-09-18T10:32:21.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012707980000000001 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195487+0000", 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003794651 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195521+0000", 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3760999999999997e-05 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:07.195550+0000", 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742e-05 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:278 3.as0 3:597221c7:::smithi16036501-40:head [create,setxattr dj[s][nsgcdlaO`ntnnogS`sZdZO[V\\]llWi\\gjj (11296) in=40b,setxattr qRNaVOjbUaQsk\\XsiZbOhrsOSoqX_Tqndtkb\\_Sa (1297) in=40b,setxattr `hdQPrsh[aUo`rPcbh\\tWT\\PatkS^p[P_Pdmcgdi (840) in=40b,setxattr RXicf\\^UcqO_mXh^am]mfcdttd\\mfOiPqZcomOo` (1822) in=40b,setxattr oZlXqWbdtOrc_U_m[apaV_Nr[hOOUgj`sVNpq^Rp (1473) in=40b,setxattr TrdTbcloOaiWXhjih\\mdXfYZcg\\^aOrnVOj^sf`s (10104) in=40b,setxattr XftrktNgjnZekN[]^ls\\[htgSaXkUrlVOqS[WcNt (1263) in=40b,setxattr ^qaVseQnk[`qOXVa`m]]NtQ\\psXaNYand^tQYrWt (1051) in=40b,setxattr b_e\\_i^rj`csr^q^\\e_boR\\lQNhcZg_NVqpgUQ`Q (418) in=40b,setxattr cfoPTk\\o\\Qqbi^XNOW[dbpcRb`OledY]YqcmmqUr (19016) in=40b,setxattr qjofnWtf]NipeS]\\gcjdaepnS_Pi^QgbRZd (10104) in=35b,setxattr mtVO^NRpeT]rQZYdTadneUO_^VXn^UdhZ^\\bUQiR (769) in=40b,setxattr prahkiNnm`U[rXSatop\\lk_p\\WVkdatg[XURZrsm (4560) in=40b,setxattr isZNUepUtPtRnYQaXpfelSVVR\\apSohRfqcfV`T_ (10033) in=40b,setxattr QZkproN[Zssrnra[rrbkaSXpatcreQpt`tWbOdoO (8349) in=40b,setxattr YqVPkaeiY^Tbe\\Rr\\heXkWjtOsi`iaN[TO\\^kP^] (876) in=40b,setxattr ZdfcZ]]snWVj]dZhZ]YSjVneRRoNbk`d^een^nqN (3368) in=40b,setxattr Y^XWcNfadqaYlbNpPbVRoPtgWreNtPrhWlfbbYY] (10804) in=40b,setxattr a`l_j\\^WlXY[ekSUURUhO (10104) in=21b,setxattr YgOToR[hPbQocWaoh\\h_NkYaghbpdean`\\kalgQ[ (1541) in=40b] snapc 8=[8,6] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-18T10:32:21.233 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.901023070000001, 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010663587, 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 278 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317931+0000", 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.317930+0000", 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318130+0000", 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020014100000000001 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318141+0000", 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1308000000000001e-05 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318146+0000", 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5419999999999999e-06 2024-09-18T10:32:21.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318184+0000", 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8597000000000003e-05 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.318296+0000", 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111852 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.319182+0000", 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00088532300000000003 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.321095+0000", 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001913131 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328552+0000", 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074568689999999997 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:29.328595+0000", 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3090999999999998e-05 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.240 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:292 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.908171842999998, 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010659095, 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 292 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310782+0000", 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310780+0000", 2024-09-18T10:32:21.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310799+0000", 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9327e-05 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310820+0000", 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0859000000000001e-05 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310829+0000", 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9600000000000006e-06 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4290999999999999e-05 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310889+0000", 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1909999999999999e-06 2024-09-18T10:32:21.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316357+0000", 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054682480000000002 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316408+0000", 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1192e-05 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.321441+0000", 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050333549999999998 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:293 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.908113595000003, 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011301637999999999, 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.246 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 293 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310841+0000", 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310840+0000", 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310844+0000", 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2350000000000001e-06 2024-09-18T10:32:21.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310854+0000", 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9340000000000001e-06 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310859+0000", 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9869999999999999e-06 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310943+0000", 2024-09-18T10:32:21.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3727999999999995e-05 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310949+0000", 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1800000000000001e-06 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316672+0000", 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057234160000000003 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316761+0000", 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8483e-05 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.322142+0000", 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053813089999999999 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:294 3.fs0 3:f4795e34:::smithi16036501-42:6 [read 0~1736704,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.908070473999999, 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012181983, 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 294 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.252 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310884+0000", 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310883+0000", 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310886+0000", 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8210000000000002e-06 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310891+0000", 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6439999999999999e-06 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310897+0000", 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3040000000000001e-06 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310968+0000", 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0729999999999995e-05 2024-09-18T10:32:21.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310973+0000", 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.853e-06 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317866+0000", 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068931009999999996 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.317931+0000", 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5177000000000003e-05 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.323066+0000", 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051347789999999999 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:295 3.as0 3:597221c7:::smithi16036501-40:head [copy-from ver 12] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:21.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.908054348999997, 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021473249999999999, 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 295 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310900+0000", 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310909+0000", 2024-09-18T10:32:21.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8190000000000003e-06 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310918+0000", 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0440000000000001e-06 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310923+0000", 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0430000000000001e-06 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310964+0000", 2024-09-18T10:32:21.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1553e-05 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310971+0000", 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6320000000000002e-06 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316320+0000", 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053496139999999999 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316416+0000", 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5945000000000004e-05 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.324379+0000", 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079626609999999994 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.329447+0000", 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050681579999999997 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332330+0000", 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028824720000000001 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.332373+0000", 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3553000000000001e-05 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:296 3.as0 3:597221c7:::smithi16036501-40:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:21.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.908022236999997, 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01562151, 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 296 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:21.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310932+0000", 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310934+0000", 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7549999999999999e-06 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310941+0000", 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5889999999999999e-06 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310946+0000", 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0259999999999998e-06 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310985+0000", 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8912000000000003e-05 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.310988+0000", 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3469999999999999e-06 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316561+0000", 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055726819999999998 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.316612+0000", 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0776000000000003e-05 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326337+0000", 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097256470000000005 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326429+0000", 2024-09-18T10:32:21.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1984999999999994e-05 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:30.326553+0000", 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012421900000000001 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:361 3.fs0 3:f96c479d:::smithi16036501-23:head [copy-from ver 4] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.625524511999998, 2024-09-18T10:32:21.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014671442, 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 361 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593430+0000", 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593428+0000", 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593438+0000", 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8490000000000001e-06 2024-09-18T10:32:21.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593456+0000", 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8763999999999999e-05 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593464+0000", 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5469999999999999e-06 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593545+0000", 2024-09-18T10:32:21.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0697000000000003e-05 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593554+0000", 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0529999999999996e-06 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595269+0000", 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017153100000000001 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595397+0000", 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012801800000000001 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.602617+0000", 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072194609999999999 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607654+0000", 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005037489 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.607731+0000", 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7068000000000001e-05 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.608101+0000", 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037002600000000002 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:362 3.fs0 3:f96c479d:::smithi16036501-23:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:32:21.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.625475508999997, 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010278183999999999, 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 362 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593479+0000", 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593478+0000", 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593482+0000", 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4399999999999998e-06 2024-09-18T10:32:21.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593553+0000", 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0816999999999996e-05 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593583+0000", 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9629999999999999e-05 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593637+0000", 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3905e-05 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.593643+0000", 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8199999999999999e-06 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595814+0000", 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021701160000000001 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.595866+0000", 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2797999999999998e-05 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603570+0000", 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00770355 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603661+0000", 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1476000000000003e-05 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:33.603757+0000", 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5461e-05 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:461 3.as0 3:52d3343a:::smithi16036501-18:head [delete] snapc 13=[d,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.578615704999997, 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01033507, 2024-09-18T10:32:21.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 461 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640338+0000", 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640336+0000", 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640345+0000", 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7749999999999998e-06 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640361+0000", 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5313999999999999e-05 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640368+0000", 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2930000000000003e-06 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640442+0000", 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3814999999999997e-05 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.640450+0000", 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3380000000000005e-06 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642167+0000", 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001716845 2024-09-18T10:32:21.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.642262+0000", 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5354999999999998e-05 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:40.650674+0000", 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084114099999999994 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:495 3.ds0 3:b4dda727:::smithi16036501-2:head [rmxattr NaWdn]fbrYUmjb`RnlX[nf]flgaVPdYaRaTsjd[_ in=40b,rmxattr Ndldqgh]PmQiPQt]XYQlRPtUrpta^^g`PPlosidN in=40b,rmxattr Wa^Tke^bWpgZXViVjeiO\\StNeTlrVofZXm\\afTgO in=40b,rmxattr XgVjiYZ\\UlNjf[Xcgc]kanprjmmN`TtrhXZN[NkY in=40b,rmxattr cTrrZmiZ\\drosZ^RTmSgdbdZt]RcZ\\RfciroNfea in=40b,rmxattr f[[l\\`WWX_\\^aPb`TiUX]la^kd_VbfYa^ha^[c[] in=40b,rmxattr nqUnbTdiWZdmero]g_b_`efZ\\^aTmXoU]\\Qfcao_ in=40b] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.619987793999996, 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010734373, 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 495 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598966+0000", 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598964+0000", 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598976+0000", 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2475e-05 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.598996+0000", 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9901000000000001e-05 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599003+0000", 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0280000000000003e-06 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599063+0000", 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9731000000000001e-05 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.599069+0000", 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2979999999999997e-06 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.600844+0000", 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001774767 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.600924+0000", 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9864999999999995e-05 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.601669+0000", 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074501199999999997 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.604092+0000", 2024-09-18T10:32:21.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002423138 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609644+0000", 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055519419999999998 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:45.609701+0000", 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6937000000000001e-05 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:561 3.fs0 3:f96c479d:::smithi16036501-23:head [copy-from ver 5] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.604960+0000", 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.613993785000002, 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014974804, 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 561 2024-09-18T10:32:21.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604960+0000", 2024-09-18T10:32:21.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604960+0000", 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604958+0000", 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604970+0000", 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2333e-05 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604987+0000", 2024-09-18T10:32:21.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7362000000000001e-05 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.604996+0000", 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1429999999999998e-06 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605063+0000", 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7836999999999994e-05 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605070+0000", 2024-09-18T10:32:21.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6429999999999998e-06 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607248+0000", 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002178358 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607351+0000", 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102774 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.613666+0000", 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063143569999999996 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.615126+0000", 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014603719999999999 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.619881+0000", 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047554720000000002 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.619935+0000", 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3872000000000002e-05 2024-09-18T10:32:21.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:562 3.fs0 3:f96c479d:::smithi16036501-23:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.613948055000002, 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099361510000000007, 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605006+0000", 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605009+0000", 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8600000000000001e-06 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605016+0000", 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5859999999999999e-06 2024-09-18T10:32:21.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605020+0000", 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8449999999999996e-06 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605119+0000", 2024-09-18T10:32:21.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9104000000000005e-05 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.605126+0000", 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1690000000000003e-06 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607525+0000", 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398266 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.607576+0000", 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1261000000000003e-05 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.614732+0000", 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007155771 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.614840+0000", 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108397 2024-09-18T10:32:21.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.614942+0000", 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102345 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:584 3.fs0 3:f184ba33:::smithi16036501-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.537415265, 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089078920000000006, 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 584 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:21.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681539+0000", 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681542+0000", 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0479999999999999e-06 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681548+0000", 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1360000000000002e-06 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.681551+0000", 2024-09-18T10:32:21.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2799999999999999e-06 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.683273+0000", 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001721562 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:21.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.683363+0000", 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0203000000000004e-05 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.689593+0000", 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062302709999999999 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.689645+0000", 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2298e-05 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:31:55.690447+0000", 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080147499999999995 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.318 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:831 3.fs0 3:f4795e34:::smithi16036501-42:head [copy-from ver 15] snapc 33=[33,30] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:10.631689+0000", 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.587265259, 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014676557999999999, 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 831 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631689+0000", 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631689+0000", 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631686+0000", 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631720+0000", 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3296000000000001e-05 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631752+0000", 2024-09-18T10:32:21.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2647000000000001e-05 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631780+0000", 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8093e-05 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631840+0000", 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9732999999999999e-05 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-09-18T10:32:21.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631850+0000", 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7850000000000003e-06 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.634788+0000", 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002938108 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.634874+0000", 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5774999999999998e-05 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.640550+0000", 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056764759999999997 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.642199+0000", 2024-09-18T10:32:21.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016484150000000001 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.646293+0000", 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040945119999999998 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.646365+0000", 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2448999999999997e-05 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:832 3.fs0 3:f4795e34:::smithi16036501-42:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e86)", 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.587146973999999, 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010017768, 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631807+0000", 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631810+0000", 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5389999999999999e-06 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631818+0000", 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1019999999999997e-06 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631822+0000", 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1160000000000001e-06 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631900+0000", 2024-09-18T10:32:21.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7377000000000001e-05 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.631906+0000", 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1340000000000001e-06 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.635000+0000", 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030940680000000002 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.635112+0000", 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112298 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.641694+0000", 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065821450000000002 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.641759+0000", 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4134999999999995e-05 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:10.641825+0000", 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6429999999999999e-05 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.333 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:934 3.as0 3:597221c7:::smithi16036501-40:head [append 0~0] snapc 3c=[3c,3b,3a,39,38,37,36] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-18T10:32:21.333 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:19.602267+0000", 2024-09-18T10:32:21.333 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.616686963, 2024-09-18T10:32:21.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087813349999999995, 2024-09-18T10:32:21.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.333 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 934 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602267+0000", 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602267+0000", 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602267+0000", 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.999999 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602270+0000", 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8319999999999999e-06 2024-09-18T10:32:21.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602278+0000", 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6599999999999995e-06 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.602283+0000", 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0799999999999996e-06 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.604554+0000", 2024-09-18T10:32:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022713379999999999 2024-09-18T10:32:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.604643+0000", 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8603000000000005e-05 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_started", 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.605107+0000", 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377799999999998 2024-09-18T10:32:21.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_committed", 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.606199+0000", 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010924649999999999 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-09-18T10:32:21.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.611001+0000", 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004801998 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:19.611049+0000", 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7305000000000002e-05 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.340 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:940 3.fs0 3:f4795e34:::smithi16036501-42:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-18T10:32:21.341 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:20.604174+0000", 2024-09-18T10:32:21.341 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.61478029700000003, 2024-09-18T10:32:21.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088520400000000003, 2024-09-18T10:32:21.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.341 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 940 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604174+0000", 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604174+0000", 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604173+0000", 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604176+0000", 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0029999999999999e-06 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604184+0000", 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1539999999999996e-06 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604188+0000", 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4259999999999996e-06 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604270+0000", 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1793999999999996e-05 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604276+0000", 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.348e-06 2024-09-18T10:32:21.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.608858+0000", 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045815270000000002 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.608941+0000", 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3584000000000005e-05 2024-09-18T10:32:21.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.613026+0000", 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040846110000000001 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4589.0:941 3.fs0 3:f4795e34:::smithi16036501-42:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-09-18T10:32:20.604194+0000", 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.614760627, 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095713970000000006, 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-09-18T10:32:21.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4589", 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 941 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604194+0000", 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604194+0000", 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604193+0000", 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604196+0000", 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0410000000000002e-06 2024-09-18T10:32:21.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604202+0000", 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.835e-06 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604211+0000", 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7399999999999993e-06 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604298+0000", 2024-09-18T10:32:21.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7155000000000002e-05 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.604303+0000", 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9089999999999999e-06 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609308+0000", 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050048829999999999 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.609393+0000", 2024-09-18T10:32:21.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5338000000000002e-05 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-09-18T10:32:20.613765+0000", 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043719259999999999 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-18T10:32:21.352 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:21.353 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:21.354 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:21.355 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:21.355 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:21.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:32:21.356 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:21.356 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:21.357 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:21.357 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:21.357 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:21.358 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:21.358 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:21.358 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:21.359 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:21.359 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.9 2024-09-18T10:32:21.359 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:21.359 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:21.360 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:21.360 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:21.360 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:21.353+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:21.373 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:21.373 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:21.389 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:21.389 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:21.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:32:21.389+0000 7f707e43b640 0 -- 172.21.15.63:0/1878705386 >> [v2:172.21.15.100:6809/33039,v1:172.21.15.100:6812/33039] conn(0x7f7078192870 msgr2=0x7f7078194c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:32:21.404 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:21.405 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:21.421 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:21.421 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:21.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-18T10:32:21.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-18T10:32:21.455 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:21.454+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:21.472 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:21.472 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:21.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:32:21.556 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:21.555+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:21.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:32:21.605 INFO:tasks.rados.rados.0.smithi160.stdout:377: done (3 left) 2024-09-18T10:32:21.605 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 2 current snap is 33 2024-09-18T10:32:21.606 INFO:tasks.rados.rados.0.smithi160.stdout:378: seq_num 157 ranges {2359296=245760} 2024-09-18T10:32:21.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:32:21.621 INFO:tasks.rados.rados.0.smithi160.stdout:378: writing smithi16036501-2 from 2359296 to 2605056 tid 1 2024-09-18T10:32:21.621 INFO:tasks.rados.rados.0.smithi160.stdout:379: rollback oid 27 current snap is 33 2024-09-18T10:32:21.621 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 27 to 29 2024-09-18T10:32:21.621 INFO:tasks.rados.rados.0.smithi160.stdout:372: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:32:21.628 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:21.628 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:21.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:32:21.656 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:21.655+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:21.663 INFO:tasks.rados.rados.0.smithi160.stdout:376: expect (ObjNum 54 snap 0 seq_num 54) 2024-09-18T10:32:21.683 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:21.683 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:21.683 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:21.691 INFO:tasks.thrashosds.thrasher:test_bluestore_reshard completed 2024-09-18T10:32:21.700 INFO:tasks.rados.rados.0.smithi160.stdout:375: expect (ObjNum 122 snap 20 seq_num 122) 2024-09-18T10:32:21.737 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:21.738 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:21.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:32:21.757 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:21.756+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:21.844 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:21.845 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:21.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:32:21.858 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:21.857+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:21.953 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:21.953 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:21.959 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:21.958+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:21.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:379: finishing rollback tid 0 to smithi16036501-27 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:378: finishing write tid 1 to smithi16036501-2 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:378: finishing write tid 2 to smithi16036501-2 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:379: finishing rollback tid 1 to smithi16036501-27 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:379: finishing rollback tid 2 to smithi16036501-27 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 27 v 19 (ObjNum 136 snap 25 seq_num 136) dirty exists 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:378: finishing write tid 3 to smithi16036501-2 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 2 v 39 (ObjNum 157 snap 33 seq_num 157) dirty exists 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:378: left oid 2 (ObjNum 157 snap 33 seq_num 157) 2024-09-18T10:32:21.978 INFO:tasks.rados.rados.0.smithi160.stdout:372: done (4 left) 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:375: done (3 left) 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:376: done (2 left) 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:378: done (1 left) 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:379: done (0 left) 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:380: rollback oid 17 current snap is 33 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 17 to 30 2024-09-18T10:32:21.979 INFO:tasks.rados.rados.0.smithi160.stdout:381: rollback oid 9 current snap is 33 2024-09-18T10:32:21.980 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 9 to 29 2024-09-18T10:32:21.980 INFO:tasks.rados.rados.0.smithi160.stdout:382: snap_create 2024-09-18T10:32:21.982 INFO:tasks.rados.rados.0.smithi160.stdout:380: finishing rollback tid 0 to smithi16036501-17 2024-09-18T10:32:21.983 INFO:tasks.rados.rados.0.smithi160.stdout:381: finishing rollback tid 0 to smithi16036501-9 2024-09-18T10:32:21.983 INFO:tasks.rados.rados.0.smithi160.stdout:380: finishing rollback tid 1 to smithi16036501-17 2024-09-18T10:32:21.986 INFO:tasks.rados.rados.0.smithi160.stdout:380: finishing rollback tid 2 to smithi16036501-17 2024-09-18T10:32:21.987 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 17 v 132 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-18T10:32:21.987 INFO:tasks.rados.rados.0.smithi160.stdout:381: finishing rollback tid 1 to smithi16036501-9 2024-09-18T10:32:21.987 INFO:tasks.rados.rados.0.smithi160.stdout:381: finishing rollback tid 2 to smithi16036501-9 2024-09-18T10:32:21.987 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 9 v 49 (ObjNum 102 snap 14 seq_num 102) dirty exists 2024-09-18T10:32:22.060 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:22.059+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:22.099 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.099 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:32:22.161 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:22.160+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:22.205 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.205 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.214 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:32:22.261 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:22.261+0000 7feecfdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 44790) UID: 0 2024-09-18T10:32:22.352 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.352 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:32:22.362 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:22.361+0000 7feecfdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 44790) UID: 0 2024-09-18T10:32:22.458 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.458 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.462 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:22.462+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:22.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:32:22.563 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.564 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.564 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:22.563+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:22.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:32:22.665 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:22.664+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:22.668 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.669 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:32:22.696 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:32:22.697 INFO:tasks.rados.rados.0.smithi160.stdout:380: done (2 left) 2024-09-18T10:32:22.697 INFO:tasks.rados.rados.0.smithi160.stdout:381: done (1 left) 2024-09-18T10:32:22.697 INFO:tasks.rados.rados.0.smithi160.stdout:382: done (0 left) 2024-09-18T10:32:22.697 INFO:tasks.rados.rados.0.smithi160.stdout:383: copy_from oid 7 from oid 13 current snap is 34 2024-09-18T10:32:22.697 INFO:tasks.rados.rados.0.smithi160.stdout:384: read oid 39 snap 26 2024-09-18T10:32:22.697 INFO:tasks.rados.rados.0.smithi160.stdout:384: expect (ObjNum 111 snap 18 seq_num 111) 2024-09-18T10:32:22.698 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 12 current snap is 34 2024-09-18T10:32:22.698 INFO:tasks.rados.rados.0.smithi160.stdout:385: seq_num 158 ranges {2146304=262144} 2024-09-18T10:32:22.710 INFO:tasks.rados.rados.0.smithi160.stdout:385: writing smithi16036501-12 from 2146304 to 2408448 tid 1 2024-09-18T10:32:22.710 INFO:tasks.rados.rados.0.smithi160.stdout:386: delete oid 33 current snap is 34 2024-09-18T10:32:22.713 INFO:tasks.rados.rados.0.smithi160.stdout:384: expect (ObjNum 111 snap 18 seq_num 111) 2024-09-18T10:32:22.766 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:22.765+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.788 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:32:22.789 INFO:tasks.rados.rados.0.smithi160.stdout:383: finishing copy_from racing read to smithi16036501-7 2024-09-18T10:32:22.789 INFO:tasks.rados.rados.0.smithi160.stdout:383: finishing copy_from to smithi16036501-7 2024-09-18T10:32:22.789 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 7 v 86 (ObjNum 62 snap 3 seq_num 62) dirty exists 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:385: finishing write tid 1 to smithi16036501-12 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:385: finishing write tid 2 to smithi16036501-12 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:383: done (3 left) 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:384: done (2 left) 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:386: done (1 left) 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 19 current snap is 34 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:385: finishing write tid 3 to smithi16036501-12 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 12 v 85 (ObjNum 158 snap 34 seq_num 158) dirty exists 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:385: left oid 12 (ObjNum 158 snap 34 seq_num 158) 2024-09-18T10:32:22.790 INFO:tasks.rados.rados.0.smithi160.stdout:387: seq_num 160 ranges {8486912=294912} 2024-09-18T10:32:22.837 INFO:tasks.rados.rados.0.smithi160.stdout:387: writing smithi16036501-19 from 8486912 to 8781824 tid 1 2024-09-18T10:32:22.837 INFO:tasks.rados.rados.0.smithi160.stdout:385: done (1 left) 2024-09-18T10:32:22.837 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 10 current snap is 34 2024-09-18T10:32:22.837 INFO:tasks.rados.rados.0.smithi160.stdout:388: seq_num 161 ranges {3555328=311296} 2024-09-18T10:32:22.858 INFO:tasks.rados.rados.0.smithi160.stdout:388: writing smithi16036501-10 from 3555328 to 3866624 tid 1 2024-09-18T10:32:22.858 INFO:tasks.rados.rados.0.smithi160.stdout:389: read oid 47 snap -1 2024-09-18T10:32:22.858 INFO:tasks.rados.rados.0.smithi160.stdout:389: expect (ObjNum 154 snap 32 seq_num 154) 2024-09-18T10:32:22.858 INFO:tasks.rados.rados.0.smithi160.stdout:390: snap_create 2024-09-18T10:32:22.859 INFO:tasks.rados.rados.0.smithi160.stdout:387: finishing write tid 1 to smithi16036501-19 2024-09-18T10:32:22.859 INFO:tasks.rados.rados.0.smithi160.stdout:387: finishing write tid 2 to smithi16036501-19 2024-09-18T10:32:22.859 INFO:tasks.rados.rados.0.smithi160.stdout:387: finishing write tid 3 to smithi16036501-19 2024-09-18T10:32:22.859 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 19 v 88 (ObjNum 160 snap 34 seq_num 160) dirty exists 2024-09-18T10:32:22.859 INFO:tasks.rados.rados.0.smithi160.stdout:387: left oid 19 (ObjNum 160 snap 34 seq_num 160) 2024-09-18T10:32:22.861 INFO:tasks.rados.rados.0.smithi160.stdout:388: finishing write tid 1 to smithi16036501-10 2024-09-18T10:32:22.863 INFO:tasks.rados.rados.0.smithi160.stdout:388: finishing write tid 2 to smithi16036501-10 2024-09-18T10:32:22.864 INFO:tasks.rados.rados.0.smithi160.stdout:388: finishing write tid 3 to smithi16036501-10 2024-09-18T10:32:22.864 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 10 v 116 (ObjNum 161 snap 34 seq_num 161) dirty exists 2024-09-18T10:32:22.864 INFO:tasks.rados.rados.0.smithi160.stdout:388: left oid 10 (ObjNum 161 snap 34 seq_num 161) 2024-09-18T10:32:22.867 INFO:tasks.rados.rados.0.smithi160.stdout:389: expect (ObjNum 154 snap 32 seq_num 154) 2024-09-18T10:32:22.867 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:22.867+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:22.892 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.892 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:22.901 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:32:22.968 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:22.967+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:22.999 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:22.999 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.008 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:32:23.069 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:23.069+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:23.105 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.105 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.113 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:32:23.170 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:23.169+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:23.212 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.213 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.221 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:32:23.271 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:23.270+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:23.320 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.320 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.328 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:32:23.372 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:23.371+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:23.425 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-18T10:32:23.426 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.426 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.434 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:32:23.473 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:23.472+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:23.532 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.532 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.541 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:32:23.558 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:23.558 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:23.573 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-18T10:32:23.573+0000 7f9476ff8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32734) UID: 0 2024-09-18T10:32:23.575 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:23.575 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:23.639 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.639 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.648 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:32:23.674 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:23.674+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:23.698 INFO:tasks.rados.rados.0.smithi160.stdout:387: done (3 left) 2024-09-18T10:32:23.699 INFO:tasks.rados.rados.0.smithi160.stdout:388: done (2 left) 2024-09-18T10:32:23.699 INFO:tasks.rados.rados.0.smithi160.stdout:389: done (1 left) 2024-09-18T10:32:23.699 INFO:tasks.rados.rados.0.smithi160.stdout:390: done (0 left) 2024-09-18T10:32:23.699 INFO:tasks.rados.rados.0.smithi160.stdout:391: snap_create 2024-09-18T10:32:23.747 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.747 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.755 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:32:23.775 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:23.775+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:23.794 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:23.810 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:23.810 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:23.825 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:23.825 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:23.841 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:23.841 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:23.853 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.853 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.857 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:23.858 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:23.862 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:32:23.873 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:23.873 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:23.875 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:23.874+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:23.889 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:23.904 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:32:23.904 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:32:23.920 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:23.921 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:23.937 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:23.953 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:23.953 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:23.960 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:23.960 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:23.968 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:32:23.969 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:23.969 INFO:teuthology.orchestra.run.smithi063.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-18T10:32:23.976 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:23.975+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:23.985 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:23.985 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:23.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:32:23.984+0000 7f1dd24fa640 0 -- 172.21.15.63:0/1230839451 >> [v2:172.21.15.160:6810/33053,v1:172.21.15.160:6812/33053] conn(0x7f1dcc195ff0 msgr2=0x7f1dcc1983d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-18T10:32:24.068 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:24.068 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:24.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:32:24.078 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:24.075+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:24.177 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:24.176+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:24.187 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:24.187 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:24.187 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-09-18T10:32:24.187 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:24.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:32:24.202 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:24.203 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:24.277 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:24.276+0000 7feecfdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 44790) UID: 0 2024-09-18T10:32:24.294 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-09-18T10:32:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-09-18T10:32:24.294 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-09-18T10:32:24.294 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:24.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:32:24.379 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:24.378+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:24.440 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-18T10:32:24.440 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-09-18T10:32:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-09-18T10:32:24.441 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [] 2024-09-18T10:32:24.441 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-18T10:32:24.449 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-18T10:32:24.480 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:24.480+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:24.554 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:24.554 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:24.554 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:24.554 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:24.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-18T10:32:24.606 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:24.605+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:24.664 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:24.664 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:24.665 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:24.665 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:24.665 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:24.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-18T10:32:24.682 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:24.682+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:24.708 INFO:tasks.rados.rados.0.smithi160.stdout:391: done (0 left) 2024-09-18T10:32:24.708 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 5 current snap is 36 2024-09-18T10:32:24.708 INFO:tasks.rados.rados.0.smithi160.stdout:392: seq_num 162 ranges {2015232=327680} 2024-09-18T10:32:24.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:32:24.720 INFO:tasks.rados.rados.0.smithi160.stdout:392: writing smithi16036501-5 from 2015232 to 2342912 tid 1 2024-09-18T10:32:24.720 INFO:tasks.rados.rados.0.smithi160.stdout:393: rmattr oid 20 current snap is 36 2024-09-18T10:32:24.721 INFO:tasks.rados.rados.0.smithi160.stdout:393: done (1 left) 2024-09-18T10:32:24.721 INFO:tasks.rados.rados.0.smithi160.stdout:394: rollback oid 11 current snap is 36 2024-09-18T10:32:24.721 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 11 to 35 2024-09-18T10:32:24.721 INFO:tasks.rados.rados.0.smithi160.stdout:395: snap_remove snap 32 2024-09-18T10:32:24.783 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:24.782+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:207 3.6s0 3:61b75516:::smithi16036501-13:head [append 0~671744] snapc 4=[4,3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 60.543922930999997, 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011106883, 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 207 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:24.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274791+0000", 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.274787+0000", 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999962 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275694+0000", 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00090683300000000001 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275721+0000", 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6876000000000002e-05 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275732+0000", 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1522000000000001e-05 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275808+0000", 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5581999999999996e-05 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.275818+0000", 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0659000000000001e-05 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278499+0000", 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026808629999999999 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.278574+0000", 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4624999999999998e-05 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.279516+0000", 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094181099999999997 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284510+0000", 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049937749999999998 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285779+0000", 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001269648 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.285898+0000", 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000118659 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.827 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:210 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 60.541207376999999, 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011901998, 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 210 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277507+0000", 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277506+0000", 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277509+0000", 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6199999999999999e-06 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277515+0000", 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.613e-06 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277519+0000", 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.162e-06 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277555+0000", 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6918999999999997e-05 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.277558+0000", 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7980000000000001e-06 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284798+0000", 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072393049999999997 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.284870+0000", 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2249999999999994e-05 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287687+0000", 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028174189999999998 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.287819+0000", 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013145400000000001 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:24.289409+0000", 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015898380000000001 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:297 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~458752] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.497158902000002, 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0124782, 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.833 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 297 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321555+0000", 2024-09-18T10:32:24.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.321554+0000", 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323224+0000", 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00166989 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323245+0000", 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1603999999999998e-05 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323251+0000", 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9070000000000004e-06 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323311+0000", 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9367000000000003e-05 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.323391+0000", 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0776e-05 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324288+0000", 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089698299999999996 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330155+0000", 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058662219999999999 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.333879+0000", 2024-09-18T10:32:24.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003724195 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.334033+0000", 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015450800000000001 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:298 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~475136] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.494470303, 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012910115999999999, 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 298 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324244+0000", 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324242+0000", 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324759+0000", 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051612499999999998 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324774+0000", 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5777000000000002e-05 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.324782+0000", 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.593e-06 2024-09-18T10:32:24.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325756+0000", 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00097372699999999997 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.325903+0000", 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014782799999999999 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326741+0000", 2024-09-18T10:32:24.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083760900000000001 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330156+0000", 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034153109999999999 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337078+0000", 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069219210000000002 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337154+0000", 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5430000000000001e-05 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:299 3.6s0 3:6fd2113e:::smithi16036501-26:head [append 0~294912] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.492467548999997, 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01141987, 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 299 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326246+0000", 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326245+0000", 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326658+0000", 2024-09-18T10:32:24.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041379600000000002 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6379e-05 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326688+0000", 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3531e-05 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327587+0000", 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00089865099999999999 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.327696+0000", 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010859 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328440+0000", 2024-09-18T10:32:24.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074455699999999997 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330157+0000", 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017169279999999999 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337590+0000", 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007433271 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337666+0000", 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5909999999999997e-05 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:300 3.6s0 3:6fd2113e:::smithi16036501-26:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.492014259000001, 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011253185000000001, 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.851 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 300 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326700+0000", 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326699+0000", 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326705+0000", 2024-09-18T10:32:24.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4219999999999997e-06 2024-09-18T10:32:24.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326713+0000", 2024-09-18T10:32:24.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2179999999999999e-06 2024-09-18T10:32:24.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326721+0000", 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8299999999999996e-06 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329116+0000", 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023944589999999998 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329207+0000", 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1532000000000004e-05 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.329752+0000", 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00054480399999999997 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331260+0000", 2024-09-18T10:32:24.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001508258 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337875+0000", 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066149590000000001 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337953+0000", 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7750000000000006e-05 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.857 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:301 3.6s0 3:6fd2113e:::smithi16036501-26:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.491987035000001, 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015768265, 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.858 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 301 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326727+0000", 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326726+0000", 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326729+0000", 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3189999999999999e-06 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326739+0000", 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3910000000000004e-06 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326744+0000", 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7119999999999999e-06 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330251+0000", 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003507175 2024-09-18T10:32:24.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330345+0000", 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3974999999999994e-05 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338416+0000", 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080714459999999995 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338553+0000", 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013656000000000001 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342495+0000", 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003942409 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:308 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.491948766999997, 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013544333, 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.864 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 308 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326768+0000", 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1820000000000002e-06 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326776+0000", 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5229999999999998e-06 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326781+0000", 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0950000000000003e-06 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330731+0000", 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039508199999999999 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.330823+0000", 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1259000000000002e-05 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340309+0000", 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0094867969999999999 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:309 3.6s0 3:61b75516:::smithi16036501-13:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.491928346999998, 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015227746, 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 309 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326786+0000", 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326785+0000", 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326789+0000", 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7239999999999998e-06 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326797+0000", 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4100000000000008e-06 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326802+0000", 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.549e-06 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332723+0000", 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059212609999999997 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.332837+0000", 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114342 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.342013+0000", 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0091760220000000007 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.7s3 56/33 ECSubWrite(tid=214, reqid=osd.4.0:214, at_version=56'60, trim_to=0'0, roll_forward_to=55'56))", 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.175703243000001, 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012700209, 2024-09-18T10:32:24.873 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643011+0000", 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.642728+0000", 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9997168 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643033+0000", 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030590899999999999 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643042+0000", 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8400000000000001e-06 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643047+0000", 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.899e-06 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644506+0000", 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001458984 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644514+0000", 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8469999999999996e-06 2024-09-18T10:32:24.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655681+0000", 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011167089 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655711+0000", 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9740999999999999e-05 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.fs6 56/33 ECSubWrite(tid=122, reqid=osd.13.0:122, at_version=56'54, trim_to=0'0, roll_forward_to=55'50))", 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 44.174807323000003, 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011833527999999999, 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643907+0000", 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643906+0000", 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643925+0000", 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9491999999999999e-05 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643936+0000", 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0251999999999999e-05 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643941+0000", 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5849999999999999e-06 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644566+0000", 2024-09-18T10:32:24.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000624999 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.644574+0000", 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1259999999999998e-06 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655717+0000", 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011142284000000001 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.655740+0000", 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3431e-05 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:493 3.6s0 3:61935b36:::smithi16036501-8:head [rollback 6] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.219713599000002, 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011749647, 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.882 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 493 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599000+0000", 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599003+0000", 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1530000000000001e-06 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599007+0000", 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.357e-06 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599010+0000", 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9050000000000001e-06 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599162+0000", 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000151698 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599172+0000", 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0538e-05 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.602723+0000", 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003550901 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.602821+0000", 2024-09-18T10:32:24.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7480999999999997e-05 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603339+0000", 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00051815499999999996 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607511+0000", 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041719299999999999 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610676+0000", 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031649569999999999 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610750+0000", 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4058000000000001e-05 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.888 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:494 3.6s0 3:61935b36:::smithi16036501-8:head [append 0~0] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.219667608000002, 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014595138000000001, 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 494 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599046+0000", 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599050+0000", 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3950000000000003e-06 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599058+0000", 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.559e-06 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599061+0000", 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4120000000000001e-06 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599218+0000", 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015663600000000001 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599222+0000", 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7770000000000002e-06 2024-09-18T10:32:24.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603678+0000", 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044553229999999997 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.603784+0000", 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106259 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.604317+0000", 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00053261499999999995 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607512+0000", 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003195603 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613563+0000", 2024-09-18T10:32:24.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060504870000000002 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613641+0000", 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8678999999999997e-05 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:497 3.6s0 3:637715d3:::smithi16036501-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.895 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.219616633999998, 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011056935, 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 497 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599097+0000", 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599101+0000", 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.895e-06 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599104+0000", 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4960000000000001e-06 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599110+0000", 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1800000000000004e-06 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599276+0000", 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016677200000000001 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599280+0000", 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3720000000000001e-06 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606994+0000", 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077141780000000004 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.607091+0000", 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6935999999999995e-05 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610154+0000", 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030633919999999999 2024-09-18T10:32:24.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:498 3.6s0 3:637715d3:::smithi16036501-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.219600464999999, 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015978455999999999, 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.901 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 498 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599113+0000", 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599116+0000", 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9900000000000002e-06 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599122+0000", 2024-09-18T10:32:24.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.823e-06 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599126+0000", 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7469999999999999e-06 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599303+0000", 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000176999 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:24.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.599310+0000", 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5939999999999996e-06 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610213+0000", 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010902935000000001 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610306+0000", 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2299999999999994e-05 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615092+0000", 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047863489999999996 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:499 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~491520] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.212809041, 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014076979999999999, 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 499 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605905+0000", 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.605903+0000", 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606922+0000", 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010196350000000001 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606937+0000", 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.467e-05 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.606944+0000", 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6379999999999998e-06 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610822+0000", 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038785320000000001 2024-09-18T10:32:24.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610929+0000", 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106656 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.612009+0000", 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001079614 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.614222+0000", 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022135829999999999 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.619906+0000", 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056843110000000001 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.619982+0000", 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5432000000000006e-05 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:500 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~589824] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.209048985000003, 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010745407, 2024-09-18T10:32:24.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 500 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609665+0000", 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.609664+0000", 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610170+0000", 2024-09-18T10:32:24.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050623900000000002 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610184+0000", 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3935e-05 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.610191+0000", 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5370000000000003e-06 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615172+0000", 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049813380000000001 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.615289+0000", 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000117366 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.616406+0000", 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001116391 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620060+0000", 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036545869999999999 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620328+0000", 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026800199999999999 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620410+0000", 2024-09-18T10:32:24.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2047999999999998e-05 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:502 3.6s0 3:623b1fe4:::smithi16036501-43:head [append 0~16384] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.205298366000001, 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010603589, 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.918 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 502 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613416+0000", 2024-09-18T10:32:24.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613414+0000", 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613432+0000", 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8111e-05 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613440+0000", 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.858e-06 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613445+0000", 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3669999999999999e-06 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620505+0000", 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0070606810000000001 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.620608+0000", 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000102965 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621026+0000", 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000417427 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622355+0000", 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001329553 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.623941+0000", 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015858859999999999 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624019+0000", 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7918999999999997e-05 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:503 3.6s0 3:623b1fe4:::smithi16036501-43:head [setxattr _header (57) in=7b] snapc 1a=[1a,17,6] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.205263903999999, 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.01079954, 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:24.924 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 503 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613450+0000", 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613449+0000", 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613454+0000", 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9919999999999998e-06 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613459+0000", 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.25e-06 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613461+0000", 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.667e-06 2024-09-18T10:32:24.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621427+0000", 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079660300000000007 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.621541+0000", 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011382099999999999 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622066+0000", 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00052472200000000004 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622656+0000", 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00059010400000000004 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624184+0000", 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001527736 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624250+0000", 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.58e-05 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.930 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:504 3.6s0 3:623b1fe4:::smithi16036501-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e61)", 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 39.205249854000002, 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011964740999999999, 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:24.931 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 504 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:24.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613464+0000", 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613465+0000", 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4899999999999999e-06 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613469+0000", 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6619999999999998e-06 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.613472+0000", 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6019999999999998e-06 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622527+0000", 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0090558270000000007 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.622626+0000", 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8653999999999994e-05 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624532+0000", 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001906072 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.624625+0000", 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2559000000000006e-05 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:45.625429+0000", 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00080416099999999996 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:24.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:24.937 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:24.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-18T10:32:24.939 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:24.937+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:25.038 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:25.037+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:25.040 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:25.040 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:25.040 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:25.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-18T10:32:25.139 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-18T10:32:25.138+0000 7f070a7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32731) UID: 0 2024-09-18T10:32:25.190 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.190 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:25.191 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:25.191 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:25.191 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:25.199 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-18T10:32:25.239 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:25.239+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:25.302 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.302 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:302 3.1s0 3:8a576e44:::smithi16036501-20:head [copy-from ver 5] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.973680123999998, 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020457712999999999, 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.303 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 302 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326558+0000", 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326556+0000", 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326570+0000", 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3662999999999999e-05 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326585+0000", 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5468000000000002e-05 2024-09-18T10:32:25.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326593+0000", 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326667+0000", 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4306000000000003e-05 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326675+0000", 2024-09-18T10:32:25.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1179999999999992e-06 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328239+0000", 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015644680000000001 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328381+0000", 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014198999999999999 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.340281+0000", 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011899197 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343588+0000", 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003307197 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346944+0000", 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033560090000000001 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347016+0000", 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2163999999999996e-05 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:303 3.1s0 3:8a576e44:::smithi16036501-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.973630866000001, 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016629574000000001, 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.309 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 303 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326608+0000", 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326607+0000", 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326611+0000", 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0389999999999998e-06 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326620+0000", 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6039999999999999e-06 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326630+0000", 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1779999999999992e-06 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326734+0000", 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104131 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326765+0000", 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1168999999999999e-05 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328659+0000", 2024-09-18T10:32:25.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018941400000000001 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.328714+0000", 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5146999999999999e-05 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343012+0000", 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014297432000000001 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343114+0000", 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010218 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343237+0000", 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000123347 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:306 3.7s0 3:e6324555:::smithi16036501-16:6 [read 0~1327104,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.973526204999999, 2024-09-18T10:32:25.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014939928, 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 306 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326712+0000", 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326715+0000", 2024-09-18T10:32:25.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7330000000000001e-06 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326724+0000", 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6249999999999996e-06 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326728+0000", 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0500000000000002e-06 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326892+0000", 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016359100000000001 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.326897+0000", 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5670000000000002e-06 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331380+0000", 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044830549999999997 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.331488+0000", 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108174 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341652+0000", 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010163635000000001 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:311 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~622592] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.320 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.963170546000001, 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013266834, 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 311 2024-09-18T10:32:25.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337068+0000", 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.337066+0000", 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999976 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338892+0000", 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0018268259999999999 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338908+0000", 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5418999999999999e-05 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338972+0000", 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4393000000000005e-05 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341761+0000", 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002788633 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.341937+0000", 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00017614900000000001 2024-09-18T10:32:25.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.343074+0000", 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001136698 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346619+0000", 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035453020000000002 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350277+0000", 2024-09-18T10:32:25.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036582979999999999 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.350335+0000", 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.736e-05 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:312 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~147456] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.961253343999999, 2024-09-18T10:32:25.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014117187999999999, 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 312 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338985+0000", 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.338983+0000", 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339142+0000", 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015861599999999999 2024-09-18T10:32:25.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339155+0000", 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2816000000000001e-05 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339164+0000", 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1749999999999994e-06 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344524+0000", 2024-09-18T10:32:25.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053596679999999997 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.344614+0000", 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0613999999999997e-05 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345181+0000", 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056671599999999999 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346674+0000", 2024-09-18T10:32:25.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00149266 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353034+0000", 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063603460000000002 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353102+0000", 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8188000000000005e-05 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:313 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (56) in=7b] snapc a=[a,8,6] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.961066652, 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014065207, 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 313 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.332 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339172+0000", 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339171+0000", 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339175+0000", 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5129999999999998e-06 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339186+0000", 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339191+0000", 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1619999999999999e-06 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345694+0000", 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065030009999999996 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.345792+0000", 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8045000000000001e-05 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346298+0000", 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00050656699999999998 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.347147+0000", 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00084835599999999998 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353189+0000", 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0060422569999999997 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353237+0000", 2024-09-18T10:32:25.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7890999999999999e-05 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:314 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 54.961041711999997, 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015236665999999999, 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.340 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 314 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339197+0000", 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339196+0000", 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339199+0000", 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8890000000000002e-06 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339206+0000", 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4200000000000001e-06 2024-09-18T10:32:25.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.339214+0000", 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1189999999999999e-06 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346686+0000", 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0074727989999999996 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.346756+0000", 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9511000000000006e-05 2024-09-18T10:32:25.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353571+0000", 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068155439999999998 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.353677+0000", 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010571 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:30.354433+0000", 2024-09-18T10:32:25.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075619700000000001 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:370 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~638976] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.704830469999997, 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.015060278, 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.345 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 370 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595408+0000", 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.595405+0000", 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596396+0000", 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00099055699999999998 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596414+0000", 2024-09-18T10:32:25.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8655999999999999e-05 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596422+0000", 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596466+0000", 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4187000000000002e-05 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.596471+0000", 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2310000000000004e-06 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598062+0000", 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015909850000000001 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598126+0000", 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4302999999999997e-05 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598945+0000", 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081903900000000003 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610343+0000", 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011397243 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610417+0000", 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4027000000000001e-05 2024-09-18T10:32:25.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.610468+0000", 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1551999999999997e-05 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:371 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~622592] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.701273577999999, 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013192463, 2024-09-18T10:32:25.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 371 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598965+0000", 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.598963+0000", 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599585+0000", 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000621708 2024-09-18T10:32:25.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599601+0000", 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512e-05 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599608+0000", 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3499999999999999e-06 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599960+0000", 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035244900000000001 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600065+0000", 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010497600000000001 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.600996+0000", 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00093031500000000003 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612013+0000", 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011017020000000001 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612082+0000", 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8853e-05 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612157+0000", 2024-09-18T10:32:25.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5618999999999995e-05 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:372 3.bs0 3:d059b4f5:::smithi16036501-10:head [append 0~147456] snapc f=[f,d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.700605897999999, 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012685169, 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.357 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 372 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599632+0000", 2024-09-18T10:32:25.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599631+0000", 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999986 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599752+0000", 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121066 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599766+0000", 2024-09-18T10:32:25.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3681e-05 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599774+0000", 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7810000000000005e-06 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601741+0000", 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019676609999999999 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601868+0000", 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012701100000000001 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602485+0000", 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061702700000000003 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612162+0000", 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096771410000000002 2024-09-18T10:32:25.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612277+0000", 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114471 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612318+0000", 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0738000000000002e-05 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:374 3.bs0 3:d059b4f5:::smithi16036501-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 50.700439056999997, 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014050109, 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 374 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599799+0000", 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599802+0000", 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9550000000000001e-06 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599808+0000", 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9689999999999999e-06 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.599811+0000", 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6370000000000001e-06 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603965+0000", 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041538549999999997 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.604070+0000", 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000104654 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612750+0000", 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0086806729999999999 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612839+0000", 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8678999999999996e-05 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.613849+0000", 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010102519999999999 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.367 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:449 3.7s0 3:e76b4e45:::smithi16036501-14:head [append 0~0] snapc 13=[11,d,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.572908069, 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013587101000000001, 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 449 2024-09-18T10:32:25.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727330+0000", 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727334+0000", 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727340+0000", 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6790000000000002e-06 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727349+0000", 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5289999999999997e-06 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737235+0000", 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0098852860000000001 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737349+0000", 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114485 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737818+0000", 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00046887099999999999 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.739481+0000", 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0016627129999999999 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740836+0000", 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0013552600000000001 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.740917+0000", 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1295e-05 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:490 3.1s0 3:86a5dc0f:::smithi16036501-49:head [append 0~0] snapc 17=[17,6] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.704541149999997, 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012816803999999999, 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.373 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 490 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595697+0000", 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595700+0000", 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.568e-06 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595707+0000", 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5860000000000001e-06 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595711+0000", 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9720000000000003e-06 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595822+0000", 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110819 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.595830+0000", 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6910000000000003e-06 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600152+0000", 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043221630000000004 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600254+0000", 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101945 2024-09-18T10:32:25.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.600730+0000", 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047567799999999999 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603018+0000", 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002287472 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608447+0000", 2024-09-18T10:32:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054292159999999997 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.608514+0000", 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7257999999999999e-05 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:565 3.7s0 3:e406830a:::smithi16036501-37:head [append 0~704512] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.680662344000002, 2024-09-18T10:32:25.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014747458999999999, 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 565 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619576+0000", 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.619575+0000", 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620250+0000", 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00067491600000000001 2024-09-18T10:32:25.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620264+0000", 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4566000000000001e-05 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620271+0000", 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1820000000000003e-06 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620306+0000", 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5108999999999999e-05 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620382+0000", 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6019999999999994e-05 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.621150+0000", 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00076778700000000003 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623627+0000", 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024771849999999998 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634275+0000", 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010647927999999999 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634323+0000", 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8860000000000003e-05 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:566 3.7s0 3:e406830a:::smithi16036501-37:head [setxattr _header (57) in=7b] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.679957556000002, 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014199358, 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 566 2024-09-18T10:32:25.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620281+0000", 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620280+0000", 2024-09-18T10:32:25.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620284+0000", 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1570000000000002e-06 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620291+0000", 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7989999999999996e-06 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620296+0000", 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3839999999999996e-06 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.621913+0000", 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001616742 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622023+0000", 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109658 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622442+0000", 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041913699999999998 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.624407+0000", 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019650779999999999 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634418+0000", 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010010968 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634480+0000", 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2088999999999995e-05 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:567 3.7s0 3:e406830a:::smithi16036501-37:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.679928412999999, 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.016946042000000001, 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.390 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 567 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620310+0000", 2024-09-18T10:32:25.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620309+0000", 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620312+0000", 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7889999999999999e-06 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620319+0000", 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.844e-06 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620323+0000", 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0180000000000003e-06 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622648+0000", 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002325063 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622738+0000", 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0117000000000005e-05 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634507+0000", 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011768548 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634560+0000", 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2877000000000002e-05 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.637256+0000", 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026962980000000002 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:571 3.7s0 3:e6324555:::smithi16036501-16:head [copy-from ver 70] snapc 23=[20] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.679909845000001, 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.018763179000000001, 2024-09-18T10:32:25.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 571 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620329+0000", 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620328+0000", 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620334+0000", 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.75e-06 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620340+0000", 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.511e-06 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620344+0000", 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9750000000000001e-06 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622803+0000", 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024588019999999999 2024-09-18T10:32:25.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.622893+0000", 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9523000000000003e-05 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.632430+0000", 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095375430000000008 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634814+0000", 2024-09-18T10:32:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023841840000000001 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.639038+0000", 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042237439999999998 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.639092+0000", 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3718000000000003e-05 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.400 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:572 3.7s0 3:e6324555:::smithi16036501-16:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 29.679889682999999, 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.013844128000000001, 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 572 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.401 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620349+0000", 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620348+0000", 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620351+0000", 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.356e-06 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620357+0000", 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8810000000000001e-06 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.620360+0000", 2024-09-18T10:32:25.403 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7450000000000001e-06 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623121+0000", 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027608300000000001 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.623171+0000", 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0099999999999998e-05 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.404 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.633947+0000", 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010775389 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634061+0000", 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011421600000000001 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.634193+0000", 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013202 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:883 3.7s0 3:e21b4941:::smithi16036501-31:head [copy-from ver 95] snapc 38=[38,37,36] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:15.682897+0000", 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.6173414279999996, 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.020542469000000001, 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 883 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.406 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682897+0000", 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682897+0000", 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682894+0000", 2024-09-18T10:32:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999971 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682914+0000", 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9772999999999999e-05 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682939+0000", 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5380000000000001e-05 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.408 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682950+0000", 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1096e-05 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683017+0000", 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7136000000000002e-05 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683025+0000", 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0039999999999999e-06 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685096+0000", 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0020712230000000001 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685213+0000", 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011642900000000001 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.697865+0000", 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012651674999999999 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.410 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.702574+0000", 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047091049999999999 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.703392+0000", 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081801400000000005 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.703439+0000", 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7695999999999999e-05 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.411 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:884 3.7s0 3:e21b4941:::smithi16036501-31:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e91)", 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:15.682964+0000", 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 9.6172742069999995, 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.017140368999999999, 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.412 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 884 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682964+0000", 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682964+0000", 2024-09-18T10:32:25.413 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682963+0000", 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682968+0000", 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1500000000000001e-06 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.414 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682980+0000", 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2666e-05 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.682986+0000", 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4500000000000003e-06 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683090+0000", 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010375 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:25.415 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.683100+0000", 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0042e-05 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685377+0000", 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022777969999999998 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for blocked object", 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.685444+0000", 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6843999999999999e-05 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.416 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.699864+0000", 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.014419390000000001 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.699963+0000", 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9487999999999993e-05 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:15.700105+0000", 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014145999999999999 2024-09-18T10:32:25.417 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.418 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.418 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.418 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.418 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:25.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-18T10:32:25.420 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:25.418+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:25.520 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:25.519+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:25.522 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.522 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:25.522 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:25.522 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:25.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-18T10:32:25.621 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:25.620+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:25.632 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.632 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:25.632 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:25.632 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:25.632 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:25.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-18T10:32:25.710 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:32:25.712 INFO:tasks.rados.rados.0.smithi160.stdout:395: done (2 left) 2024-09-18T10:32:25.712 INFO:tasks.rados.rados.0.smithi160.stdout:396: snap_remove snap 28 2024-09-18T10:32:25.722 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:25.721+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:25.751 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.751 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:366 3.4s0 3:2e7558df:::smithi16036501-5:head [delete] snapc d=[d,b,6] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-18T10:32:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 52.155757999999999, 2024-09-18T10:32:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095772340000000004, 2024-09-18T10:32:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.752 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 366 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593487+0000", 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593485+0000", 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593493+0000", 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9000000000000006e-06 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593511+0000", 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8011000000000001e-05 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593517+0000", 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.781e-06 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593607+0000", 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9117999999999996e-05 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.593636+0000", 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9022000000000001e-05 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594774+0000", 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001138376 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.594884+0000", 2024-09-18T10:32:25.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110449 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.595595+0000", 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00071014400000000001 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.598115+0000", 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0025207670000000001 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.602981+0000", 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048657020000000004 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.603064+0000", 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2763999999999996e-05 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:367 3.4s0 3:22c8281c:::smithi16036501-32:head [create,setxattr nWX_d[W\\dXUWOgbXndrSbcTU`mgjR_]o\\nNcXpin (1403) in=40b,setxattr TSP[ddnm_WR]nh]QhSXpkpmmWeOP^b]baemT^Uqr (630) in=40b,setxattr R[QU^NWYrjfarmhlWmZlUkP\\ipWan`SnqZOX`VWh (806) in=40b,setxattr ]hV\\^[PQZO]n^abhilRfldoUhgtl\\\\oel`mgahd_ (3368) in=40b,setxattr OYc`XQ\\VjZfQ`]OsbemUo_mfVUSc^pNo\\[\\ldrhg (1087) in=40b,setxattr `pZtTmno_eqZOONfatgZ_`nnhemaaQWiteO]dc[V (175) in=40b,setxattr PdQa`feQapkrnjfOUYUeqsOt_hrsg\\noqrcV]pSh (981) in=40b,setxattr bk_QpaSsdlQfT`oa[pTQS_[ad]isfYm^tQNdhSiW (1718) in=40b,setxattr Ys`Y_UZ^PXhpgS`VS]`eVgkcmT^QW[aWscssRRSr (10033) in=40b,setxattr [jd]Q\\qemWTVcc`hiZnsrqrggetajZRa]\\_llS`h (1367) in=40b,setxattr `UajoeZh]tRSf\\[nnVat^TjN^_q`ooQ_br`itgZm (244) in=40b,setxattr Tng[WcWa_dsnRXtZNa^`fle`gQ___mar\\fgRsZVY (665) in=40b,setxattr nogmhepVZfQtnZc^cZSeaaogjklZkrff_Utg`UR^ (15856) in=40b,setxattr gfqSsQY[][rrac[gmaQrTSacNWttTTXhanmRa^fa (1998) in=40b,setxattr V`Y[ddb`_dfep[_]oUoTqQj\\UW[gkesnlgNPYtPa (1438) in=40b,setxattr YgoRVqUOj_mXPXsq^PdjaaolmQsTsTsZpaddktl[ (1400) in=40b,setxattr smn[QVPVkfVs]oTip]jtirOtU\\Pa\\Ym^poZgfZaq (1263) in=40b,setxattr TQSmSs^Z]\\rdosO_a^TOU^[p`jkQb`dXXh]s`Stq (909) in=40b,setxattr faPhpqVXmWh`VeNZo[b^[kYl^[[rYYPRrk_[ON`e (14664) in=40b,setxattr ksO_UmqqQefe[Q\\njt[W_roWeei`]Sn^TV]O^iSW (1963) in=40b] snapc d=[d,b,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:25.758 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 52.143108943000001, 2024-09-18T10:32:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0068636369999999997, 2024-09-18T10:32:25.759 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 367 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606136+0000", 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606134+0000", 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:25.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606259+0000", 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012537799999999999 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606277+0000", 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7677e-05 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606284+0000", 2024-09-18T10:32:25.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1629999999999999e-06 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606326+0000", 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1956000000000003e-05 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.606462+0000", 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000136422 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.607463+0000", 2024-09-18T10:32:25.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010009730000000001 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.609207+0000", 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0017437399999999999 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612922+0000", 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003715281 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:33.612999+0000", 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6951000000000002e-05 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.020358696999999, 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063305380000000001, 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.765 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728886+0000", 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728885+0000", 2024-09-18T10:32:25.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728993+0000", 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108399 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729010+0000", 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6674999999999999e-05 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729017+0000", 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4760000000000001e-06 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729076+0000", 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8768999999999999e-05 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729087+0000", 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0370999999999999e-05 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735190+0000", 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061034770000000004 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.735216+0000", 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6321000000000001e-05 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.769 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.019597017999999, 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075128, 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729648+0000", 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729647+0000", 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729962+0000", 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031509799999999998 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729974+0000", 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2442999999999999e-05 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729985+0000", 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0778000000000001e-05 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730933+0000", 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00094732900000000001 2024-09-18T10:32:25.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730946+0000", 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2981e-05 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737129+0000", 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061833449999999998 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737160+0000", 2024-09-18T10:32:25.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1452000000000003e-05 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.018380639, 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063226910000000001, 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730864+0000", 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730863+0000", 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730879+0000", 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6008e-05 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730889+0000", 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6860000000000001e-06 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.730894+0000", 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6339999999999998e-06 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731351+0000", 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000456577 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731360+0000", 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0520000000000007e-06 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737174+0000", 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058143250000000004 2024-09-18T10:32:25.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.737187+0000", 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2310000000000001e-05 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 56/33 ECSubWrite(tid=119, reqid=osd.13.0:119, at_version=56'8, trim_to=0'0, roll_forward_to=53'6))", 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.106030822999998, 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056619699999999997, 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.778 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643214+0000", 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643213+0000", 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643236+0000", 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3031999999999999e-05 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643245+0000", 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6619999999999994e-06 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643251+0000", 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8529999999999997e-06 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643299+0000", 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7874000000000003e-05 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643308+0000", 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4390000000000006e-06 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648839+0000", 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055302210000000001 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648876+0000", 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7181999999999997e-05 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/33 ECSubWrite(tid=84, reqid=osd.5.0:84, at_version=56'25, trim_to=0'0, roll_forward_to=55'23))", 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.102591171999997, 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066185949999999997, 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646653+0000", 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646674+0000", 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1492e-05 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646686+0000", 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1752e-05 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646692+0000", 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0260000000000004e-06 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646751+0000", 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9382000000000002e-05 2024-09-18T10:32:25.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.646762+0000", 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1042e-05 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653246+0000", 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0064839570000000003 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.653272+0000", 2024-09-18T10:32:25.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5605999999999998e-05 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=95, reqid=client.4589.0:487, at_version=60'41, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.148043319000003, 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.009354111, 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601201+0000", 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601216+0000", 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5795e-05 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601228+0000", 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1372999999999999e-05 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601234+0000", 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.178e-06 2024-09-18T10:32:25.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601802+0000", 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00056782999999999996 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.601812+0000", 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.027e-05 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610535+0000", 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087234549999999998 2024-09-18T10:32:25.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610555+0000", 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9879000000000001e-05 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=96, reqid=osd.5.0:96, at_version=60'43, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.147181938999999, 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085102259999999992, 2024-09-18T10:32:25.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602063+0000", 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602062+0000", 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602086+0000", 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.393e-05 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602098+0000", 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1949e-05 2024-09-18T10:32:25.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602104+0000", 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3740000000000003e-06 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602590+0000", 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048540399999999999 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.602599+0000", 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2029999999999998e-06 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610562+0000", 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079633459999999996 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610573+0000", 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0791000000000001e-05 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 60/33 ECSubWrite(tid=131, reqid=osd.13.0:131, at_version=60'10, trim_to=0'0, roll_forward_to=56'8))", 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.146207674999999, 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0067723929999999998, 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603037+0000", 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603070+0000", 2024-09-18T10:32:25.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2941999999999997e-05 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603082+0000", 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2391e-05 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603088+0000", 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3280000000000002e-06 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603148+0000", 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0093000000000002e-05 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.603159+0000", 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0217999999999999e-05 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609781+0000", 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066224500000000002 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.609809+0000", 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8194000000000001e-05 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=97, reqid=osd.5.0:97, at_version=60'45, trim_to=0'0, roll_forward_to=56'37))", 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.144762157999999, 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061409799999999999, 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.800 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604482+0000", 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604503+0000", 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1679e-05 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604516+0000", 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2172e-05 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604522+0000", 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2430000000000002e-06 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604689+0000", 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000166928 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.604699+0000", 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0586e-05 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610607+0000", 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059073229999999999 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.610623+0000", 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6792000000000001e-05 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs1 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:32:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.137883059000004, 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058420499999999997, 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611362+0000", 2024-09-18T10:32:25.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611361+0000", 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611370+0000", 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1959999999999997e-06 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611381+0000", 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1175000000000001e-05 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611386+0000", 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6059999999999996e-06 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611448+0000", 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1869e-05 2024-09-18T10:32:25.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611457+0000", 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6609999999999995e-06 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617180+0000", 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057225189999999997 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.617204+0000", 2024-09-18T10:32:25.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3652e-05 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 96/77 ECSubWrite(tid=247, reqid=osd.13.0:247, at_version=96'34, trim_to=0'0, roll_forward_to=94'32))", 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.609770+0000", 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1394747599999997, 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0066656909999999996, 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609770+0000", 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609770+0000", 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609770+0000", 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609787+0000", 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6833999999999998e-05 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609797+0000", 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0509000000000001e-05 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609802+0000", 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.181e-06 2024-09-18T10:32:25.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609862+0000", 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9348000000000002e-05 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.609869+0000", 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2509999999999997e-06 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.616401+0000", 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065324609999999998 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.616436+0000", 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4236000000000002e-05 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s1 96/77 ECSubWrite(tid=181, reqid=osd.5.0:178, at_version=0'0, trim_to=0'0, roll_forward_to=96'51))", 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.613456+0000", 2024-09-18T10:32:25.813 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1357883370000001, 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011279716, 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613456+0000", 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613456+0000", 2024-09-18T10:32:25.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613455+0000", 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613470+0000", 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4259e-05 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613487+0000", 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7484999999999999e-05 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613539+0000", 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1992e-05 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613734+0000", 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019512300000000001 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613746+0000", 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1766000000000001e-05 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.624693+0000", 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010947093 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.624736+0000", 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2889000000000002e-05 2024-09-18T10:32:25.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es4 96/33 ECSubWrite(tid=64, reqid=osd.11.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=96'45))", 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.614030+0000", 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1352143379999999, 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010714349, 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614030+0000", 2024-09-18T10:32:25.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614030+0000", 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614029+0000", 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614043+0000", 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4304999999999999e-05 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614066+0000", 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2093999999999999e-05 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614079+0000", 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.362e-05 2024-09-18T10:32:25.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614136+0000", 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7312000000000003e-05 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614147+0000", 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0162e-05 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.624693+0000", 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010546514999999999 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.624745+0000", 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1431000000000003e-05 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.9s5 96/33 ECSubWrite(tid=20, reqid=osd.7.0:19, at_version=0'0, trim_to=0'0, roll_forward_to=96'14))", 2024-09-18T10:32:25.822 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.615148+0000", 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1340966149999998, 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0096367050000000006, 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615148+0000", 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615148+0000", 2024-09-18T10:32:25.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615147+0000", 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615167+0000", 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9629000000000001e-05 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615181+0000", 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4504999999999999e-05 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615194+0000", 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2517999999999999e-05 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615249+0000", 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5182000000000001e-05 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615265+0000", 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6036e-05 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.624749+0000", 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0094840819999999996 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.624785+0000", 2024-09-18T10:32:25.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5775000000000002e-05 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.ds5 96/77 ECSubWrite(tid=253, reqid=osd.13.0:247, at_version=0'0, trim_to=0'0, roll_forward_to=96'34))", 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.617272+0000", 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.1319725509999996, 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007854069, 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617272+0000", 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617272+0000", 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617271+0000", 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617284+0000", 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3159000000000001e-05 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617300+0000", 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5866e-05 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617308+0000", 2024-09-18T10:32:25.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5009999999999998e-06 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617361+0000", 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2991000000000001e-05 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.617371+0000", 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0570999999999999e-05 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.625104+0000", 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077324380000000003 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.625126+0000", 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2563000000000001e-05 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:983 3.4s0 3:2e7558df:::smithi16036501-5:head [append 0~327680] snapc 41=[41,40,3f,3c,3a,39,38,36] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:24.720471+0000", 2024-09-18T10:32:25.831 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.0287736439999999, 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078699579999999998, 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 983 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720471+0000", 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720471+0000", 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720469+0000", 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999981 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720873+0000", 2024-09-18T10:32:25.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00040412500000000002 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720896+0000", 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2512999999999999e-05 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720917+0000", 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1625e-05 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720978+0000", 2024-09-18T10:32:25.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0625000000000003e-05 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op must wait for map", 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720987+0000", 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1530000000000003e-06 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.723085+0000", 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002097617 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.723144+0000", 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9446e-05 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.723789+0000", 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00064437299999999995 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.725381+0000", 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015927510000000001 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.728266+0000", 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0028845310000000001 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.728341+0000", 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4924000000000003e-05 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:984 3.4s0 3:2e7558df:::smithi16036501-5:head [setxattr _header (56) in=7b] snapc 41=[41,40,3f,3c,3a,39,38,36] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-18T10:32:25.837 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:24.720937+0000", 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.0283080529999999, 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.007632509, 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 984 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720937+0000", 2024-09-18T10:32:25.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720937+0000", 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720936+0000", 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720949+0000", 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.346e-05 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720958+0000", 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4659999999999999e-06 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720962+0000", 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7859999999999996e-06 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.721064+0000", 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000101989 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.721071+0000", 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1099999999999997e-06 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.724652+0000", 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035810289999999999 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.724714+0000", 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1999000000000001e-05 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.725114+0000", 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000399286 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.725586+0000", 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047237599999999999 2024-09-18T10:32:25.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.728519+0000", 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002932605 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.728569+0000", 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0287999999999997e-05 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(client.4589.0:985 3.4s0 3:2e7558df:::smithi16036501-5:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e100)", 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:24.720970+0000", 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.028274586, 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0092040890000000004, 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_info": { 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client": "client.4589", 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "client_addr": "172.21.15.160:0/1382173294", 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tid": 985 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720970+0000", 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720970+0000", 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720969+0000", 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720973+0000", 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3380000000000001e-06 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720980+0000", 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5490000000000001e-06 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.720987+0000", 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9140000000000002e-06 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.721108+0000", 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120789 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting_for_map not empty", 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.721114+0000", 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1090000000000003e-06 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.725309+0000", 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041946140000000002 2024-09-18T10:32:25.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for rw locks", 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.725373+0000", 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4567999999999996e-05 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.728823+0000", 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034500989999999999 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.728881+0000", 2024-09-18T10:32:25.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7967999999999998e-05 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:24.730174+0000", 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001292699 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:25.849 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:25.851 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-18T10:32:25.851 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:25.850+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:25.951 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:25.950+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:25.993 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:25.994 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-18T10:32:25.994 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:26.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-18T10:32:26.087 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-09-18T10:32:26.086+0000 7fe4335f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33459) UID: 0 2024-09-18T10:32:26.144 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:26.144 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-18T10:32:26.144 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 30, 2024-09-18T10:32:26.144 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-18T10:32:26.144 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:26.153 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-18T10:32:26.153 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:26.151+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:26.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-18T10:32:26.280 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-18T10:32:26.279+0000 7f7c0c9f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33458) UID: 0 2024-09-18T10:32:26.297 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=175, reqid=client.4589.0:371, at_version=50'43, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.694067912000001, 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010486074, 2024-09-18T10:32:26.298 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601334+0000", 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601333+0000", 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601448+0000", 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115426 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601462+0000", 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3579e-05 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601469+0000", 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0530000000000001e-06 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601650+0000", 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000181273 2024-09-18T10:32:26.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.601659+0000", 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3739999999999998e-06 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611795+0000", 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010135877999999999 2024-09-18T10:32:26.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.611820+0000", 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5400000000000001e-05 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=176, reqid=client.4589.0:372, at_version=50'44, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.692797167000002, 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0095436749999999997, 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602605+0000", 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602604+0000", 2024-09-18T10:32:26.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602653+0000", 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8948e-05 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602666+0000", 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2779000000000001e-05 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602674+0000", 2024-09-18T10:32:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3210000000000005e-06 2024-09-18T10:32:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602759+0000", 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5636999999999993e-05 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.602770+0000", 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0465000000000001e-05 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612126+0000", 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0093557369999999994 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612148+0000", 2024-09-18T10:32:26.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2736000000000001e-05 2024-09-18T10:32:26.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.312 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/33 ECSubWrite(tid=177, reqid=client.4589.0:373, at_version=50'45, trim_to=0'0, roll_forward_to=49'41))", 2024-09-18T10:32:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.691639776999999, 2024-09-18T10:32:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0084016750000000008, 2024-09-18T10:32:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603762+0000", 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603761+0000", 2024-09-18T10:32:26.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603784+0000", 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2696000000000001e-05 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603798+0000", 2024-09-18T10:32:26.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4199000000000001e-05 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603805+0000", 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6200000000000001e-06 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603872+0000", 2024-09-18T10:32:26.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7512e-05 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.603883+0000", 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0729e-05 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612153+0000", 2024-09-18T10:32:26.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082698349999999997 2024-09-18T10:32:26.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:34.612164+0000", 2024-09-18T10:32:26.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.078e-05 2024-09-18T10:32:26.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.320 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.320 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.320 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=71, reqid=client.4589.0:436, at_version=55'20, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.568461354999997, 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065126710000000003, 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726941+0000", 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.726940+0000", 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727360+0000", 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00041924799999999999 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727372+0000", 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2152e-05 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727379+0000", 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8730000000000001e-06 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727436+0000", 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7802e-05 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.727446+0000", 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2520000000000005e-06 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733427+0000", 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0059812659999999998 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.733453+0000", 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6302e-05 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=72, reqid=client.4589.0:437, at_version=55'21, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:26.327 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.566416259999997, 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0075586109999999998, 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:26.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728986+0000", 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.728985+0000", 2024-09-18T10:32:26.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729148+0000", 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016313100000000001 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729165+0000", 2024-09-18T10:32:26.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7489000000000001e-05 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729182+0000", 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6079999999999999e-05 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729230+0000", 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8004000000000003e-05 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.729240+0000", 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0327e-05 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736514+0000", 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072737649999999997 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736544+0000", 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0602000000000003e-05 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.333 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=73, reqid=client.4589.0:438, at_version=55'22, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.564374145000002, 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055584830000000003, 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731028+0000", 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.335 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731027+0000", 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731125+0000", 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8250000000000003e-05 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731138+0000", 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3022e-05 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731146+0000", 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.571e-06 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731229+0000", 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3368999999999994e-05 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731239+0000", 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5880000000000004e-06 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736576+0000", 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0053372209999999996 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736586+0000", 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0389e-05 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.338 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 55/33 ECSubWrite(tid=74, reqid=client.4589.0:439, at_version=55'23, trim_to=0'0, roll_forward_to=53'18))", 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.564241504000002, 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054374030000000004, 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731160+0000", 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731178+0000", 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8043999999999999e-05 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731187+0000", 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0189999999999995e-06 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731193+0000", 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6169999999999998e-06 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731650+0000", 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00045705799999999999 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.731659+0000", 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4630000000000007e-06 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736588+0000", 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004929124 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:39.736598+0000", 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5089999999999999e-06 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 56/33 ECSubWrite(tid=215, reqid=client.4589.0:459, at_version=56'59, trim_to=0'0, roll_forward_to=53'55))", 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 45.651955444000002, 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0048391809999999997, 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:26.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643446+0000", 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643445+0000", 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643467+0000", 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1481e-05 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643482+0000", 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4612e-05 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643490+0000", 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2150000000000001e-06 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643544+0000", 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4302000000000003e-05 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.643556+0000", 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2136999999999999e-05 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648259+0000", 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047024700000000003 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:40.648286+0000", 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6923999999999998e-05 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 60/33 ECSubWrite(tid=99, reqid=osd.5.0:97, at_version=0'0, trim_to=0'0, roll_forward_to=60'45))", 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 41.684032393000003, 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051192939999999999, 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.347 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611369+0000", 2024-09-18T10:32:26.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611380+0000", 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1643e-05 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611392+0000", 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1902000000000001e-05 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611399+0000", 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1130000000000003e-06 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611450+0000", 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0590000000000002e-05 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.611461+0000", 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0616e-05 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616457+0000", 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049963660000000003 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:44.616489+0000", 2024-09-18T10:32:26.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1863999999999998e-05 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 65/33 ECSubWrite(tid=107, reqid=client.4589.0:543, at_version=65'52, trim_to=0'0, roll_forward_to=64'51))", 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:26.352 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.633885313, 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047841719999999997, 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661517+0000", 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.661516+0000", 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967296 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662367+0000", 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000850492 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662384+0000", 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6991e-05 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662391+0000", 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1709999999999996e-06 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662450+0000", 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8943999999999997e-05 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.662462+0000", 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2033e-05 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666279+0000", 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038165149999999999 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:49.666301+0000", 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2157000000000001e-05 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 71/33 ECSubWrite(tid=306, reqid=client.4589.0:587, at_version=71'95, trim_to=0'0, roll_forward_to=71'93))", 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 30.599007241999999, 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047899739999999998, 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696395+0000", 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696394+0000", 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696497+0000", 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103317 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696511+0000", 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4279e-05 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696524+0000", 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2311e-05 2024-09-18T10:32:26.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696574+0000", 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0018999999999997e-05 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.696580+0000", 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3419999999999996e-06 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.701169+0000", 2024-09-18T10:32:26.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045889149999999998 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:31:55.701185+0000", 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5775999999999999e-05 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 86/77 ECSubWrite(tid=147, reqid=client.4589.0:824, at_version=86'39, trim_to=0'0, roll_forward_to=83'37))", 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:10.623208+0000", 2024-09-18T10:32:26.361 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 15.672194168000001, 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005238454, 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623208+0000", 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623208+0000", 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623207+0000", 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623699+0000", 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049184100000000002 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623710+0000", 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1581e-05 2024-09-18T10:32:26.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.623717+0000", 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0299999999999996e-06 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.624211+0000", 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00049357700000000003 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.624223+0000", 2024-09-18T10:32:26.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1758e-05 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.628416+0000", 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041928399999999998 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:10.628446+0000", 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0502999999999999e-05 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 96/77 ECSubWrite(tid=178, reqid=osd.5.0:178, at_version=96'51, trim_to=0'0, roll_forward_to=90'49))", 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.604014+0000", 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6913883639999998, 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.008972898, 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604014+0000", 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604014+0000", 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604013+0000", 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604047+0000", 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4118000000000001e-05 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604068+0000", 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1330000000000001e-05 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604078+0000", 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0081999999999999e-05 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604182+0000", 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103599 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604196+0000", 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4749999999999999e-05 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.612925+0000", 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.008728464 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.612986+0000", 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1524000000000003e-05 2024-09-18T10:32:26.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es6 96/33 ECSubWrite(tid=63, reqid=osd.11.0:63, at_version=96'45, trim_to=0'0, roll_forward_to=92'43))", 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.604263+0000", 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6911387199999997, 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0087694369999999997, 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604263+0000", 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604263+0000", 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604263+0000", 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.371 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604290+0000", 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6761999999999999e-05 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604303+0000", 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3193999999999999e-05 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604311+0000", 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8480000000000001e-06 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604400+0000", 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9239000000000004e-05 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604426+0000", 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5998000000000001e-05 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.612997+0000", 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0085713179999999996 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613033+0000", 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5370000000000002e-05 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(3.5s4 epoch 96/77 rep_tid 179 entries 96'52 (0'0) error 3:ac3be3d0:::smithi16036501-3:head by client.4589.0:942 0.000000 -2 [r=-2+0b,r=0+0b] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 90'48)", 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.604806+0000", 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6905958420000005, 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0081962749999999994, 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.374 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604806+0000", 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604806+0000", 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604805+0000", 2024-09-18T10:32:26.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604817+0000", 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1542999999999999e-05 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604840+0000", 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3468999999999998e-05 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604863+0000", 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2731e-05 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.604921+0000", 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8248999999999997e-05 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613002+0000", 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080810949999999999 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 96/33 ECSubWrite(tid=180, reqid=osd.5.0:177, at_version=0'0, trim_to=0'0, roll_forward_to=96'80))", 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.607984+0000", 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6874181630000002, 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079658750000000007, 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.607984+0000", 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.607984+0000", 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.607983+0000", 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.607996+0000", 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3458999999999999e-05 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.608012+0000", 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5662e-05 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.608020+0000", 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0020000000000006e-06 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.608072+0000", 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2247000000000003e-05 2024-09-18T10:32:26.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.608082+0000", 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0093e-05 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615923+0000", 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078411580000000008 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615950+0000", 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6443000000000001e-05 2024-09-18T10:32:26.381 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.5s4 96/77 ECSubWrite(tid=181, reqid=osd.5.0:178, at_version=0'0, trim_to=0'0, roll_forward_to=96'51))", 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.613529+0000", 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.681873285, 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0083644110000000004, 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613529+0000", 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613529+0000", 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613528+0000", 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613541+0000", 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.329e-05 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613554+0000", 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2621e-05 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613561+0000", 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9460000000000001e-06 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613624+0000", 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3343000000000007e-05 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.613634+0000", 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0509000000000001e-05 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.621851+0000", 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082165239999999994 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.621893+0000", 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2129000000000003e-05 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.es6 96/33 ECSubWrite(tid=64, reqid=osd.11.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=96'45))", 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.614043+0000", 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6813587319999996, 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0079008480000000002, 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.386 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614043+0000", 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614043+0000", 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.387 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614042+0000", 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.999999 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614056+0000", 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3525e-05 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614076+0000", 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9901000000000001e-05 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.388 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614084+0000", 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4619999999999996e-06 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614144+0000", 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9988999999999998e-05 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614154+0000", 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5210000000000008e-06 2024-09-18T10:32:26.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.621910+0000", 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0077563329999999998 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.621944+0000", 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4146999999999997e-05 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.390 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.bs3 96/33 ECSubWrite(tid=425, reqid=osd.4.0:425, at_version=96'111, trim_to=0'0, roll_forward_to=95'109))", 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:20.614782+0000", 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 5.6806195129999999, 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072163569999999996, 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614782+0000", 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.391 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614782+0000", 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614782+0000", 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614811+0000", 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8569e-05 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.392 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614897+0000", 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6873000000000007e-05 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.614908+0000", 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.009e-05 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615051+0000", 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000143401 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.393 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.615060+0000", 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3449999999999995e-06 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.621971+0000", 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0069103109999999997 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:20.621999+0000", 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8107e-05 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.394 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(3.cs5 101/33 ECSubWrite(tid=193, reqid=osd.5.0:193, at_version=101'92, trim_to=0'0, roll_forward_to=98'88))", 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-18T10:32:25.721420+0000", 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.57398221699999996, 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047656019999999999, 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721420+0000", 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721420+0000", 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721419+0000", 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4294967295.9999995 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-18T10:32:26.396 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721443+0000", 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3717999999999999e-05 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721457+0000", 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4194e-05 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721464+0000", 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7989999999999996e-06 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-18T10:32:26.397 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721532+0000", 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8570000000000002e-05 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.721542+0000", 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.2690000000000005e-06 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.726160+0000", 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046189309999999997 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-18T10:32:26.398 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-18T10:32:25.726185+0000", 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4819000000000001e-05 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-18T10:32:26.399 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:32:26.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-18T10:32:26.401 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-18T10:32:26.401 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-18T10:32:26.402 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-18T10:32:26.402 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-18T10:32:26.402 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-18T10:32:26.402 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-18T10:32:26.403 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:26.399+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:26.406 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-18T10:32:26.406 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-18T10:32:26.420 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-18T10:32:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-18T10:32:26.437 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-18T10:32:26.437 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-18T10:32:26.453 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-18T10:32:26.453 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-18T10:32:26.469 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-18T10:32:26.469 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-18T10:32:26.484 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8: {} 2024-09-18T10:32:26.484 INFO:teuthology.orchestra.run.smithi063.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-18T10:32:26.501 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9: {} 2024-09-18T10:32:26.501 INFO:tasks.ceph.osd.12.smithi063.stderr:2024-09-18T10:32:26.500+0000 7f863c7f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33466) UID: 0 2024-09-18T10:32:26.501 INFO:teuthology.orchestra.run.smithi063.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-18T10:32:26.513 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:26.513 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:26.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-18T10:32:26.601 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:26.600+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:26.621 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:26.621 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:26.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-18T10:32:26.692 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 10, 11, 12, 13, 14, 15] out_osds: [9] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 13, 2, 6, 10, 14, 3, 7, 11, 15, 9] 2024-09-18T10:32:26.692 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-18T10:32:26.692 INFO:tasks.thrashosds.thrasher:inject_pause on osd.14 2024-09-18T10:32:26.692 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-18T10:32:26.692 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-18T10:32:26.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok config set filestore_inject_stall 3 2024-09-18T10:32:26.703 INFO:tasks.ceph.osd.3.smithi160.stderr:2024-09-18T10:32:26.702+0000 7ff276bf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33040) UID: 0 2024-09-18T10:32:26.719 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10: {} 2024-09-18T10:32:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-18T10:32:26.725 INFO:tasks.rados.rados.0.smithi160.stdout:394: finishing rollback tid 1 to smithi16036501-11 2024-09-18T10:32:26.725 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 11 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2024-09-18T10:32:26.725 INFO:tasks.rados.rados.0.smithi160.stdout:392: finishing write tid 1 to smithi16036501-5 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:392: finishing write tid 2 to smithi16036501-5 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:392: finishing write tid 3 to smithi16036501-5 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 5 v 67 (ObjNum 162 snap 36 seq_num 162) dirty exists 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:392: left oid 5 (ObjNum 162 snap 36 seq_num 162) 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:392: done (2 left) 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:394: done (1 left) 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:396: done (0 left) 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:append oid 24 current snap is 36 2024-09-18T10:32:26.726 INFO:tasks.rados.rados.0.smithi160.stdout:397: seq_num 163 ranges {1409024=344064} 2024-09-18T10:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:26.734 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:26.735 INFO:tasks.rados.rados.0.smithi160.stdout:397: writing smithi16036501-24 from 1409024 to 1753088 tid 1 2024-09-18T10:32:26.735 INFO:tasks.rados.rados.0.smithi160.stdout:398: delete oid 9 current snap is 36 2024-09-18T10:32:26.745 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11: {} 2024-09-18T10:32:26.745 INFO:tasks.rados.rados.0.smithi160.stdout:398: done (1 left) 2024-09-18T10:32:26.746 INFO:tasks.rados.rados.0.smithi160.stdout:399: rollback oid 37 current snap is 36 2024-09-18T10:32:26.746 INFO:tasks.rados.rados.0.smithi160.stdout:rollback oid 37 to 35 2024-09-18T10:32:26.746 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 2 2024-09-18T10:32:26.746 INFO:teuthology.orchestra.run.smithi063.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-18T10:32:26.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-18T10:32:26.749 INFO:tasks.rados.rados.0.smithi160.stdout:397: finishing write tid 1 to smithi16036501-24 2024-09-18T10:32:26.749 INFO:tasks.rados.rados.0.smithi160.stdout:397: finishing write tid 2 to smithi16036501-24 2024-09-18T10:32:26.750 INFO:tasks.rados.rados.0.smithi160.stdout:397: finishing write tid 3 to smithi16036501-24 2024-09-18T10:32:26.751 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 24 v 86 (ObjNum 163 snap 36 seq_num 163) dirty exists 2024-09-18T10:32:26.751 INFO:tasks.rados.rados.0.smithi160.stdout:397: left oid 24 (ObjNum 163 snap 36 seq_num 163) 2024-09-18T10:32:26.751 INFO:tasks.rados.rados.0.smithi160.stdout:397: done (1 left) 2024-09-18T10:32:26.752 INFO:tasks.rados.rados.0.smithi160.stdout: waiting on 1 2024-09-18T10:32:26.753 INFO:tasks.rados.rados.0.smithi160.stdout:399: finishing rollback tid 0 to smithi16036501-37 2024-09-18T10:32:26.754 INFO:tasks.rados.rados.0.smithi160.stdout:399: finishing rollback tid 1 to smithi16036501-37 2024-09-18T10:32:26.754 INFO:tasks.rados.rados.0.smithi160.stdout:399: finishing rollback tid 2 to smithi16036501-37 2024-09-18T10:32:26.754 INFO:tasks.rados.rados.0.smithi160.stdout:update_object_version oid 37 v 131 (ObjNum 129 snap 23 seq_num 129) dirty exists 2024-09-18T10:32:26.754 INFO:tasks.rados.rados.0.smithi160.stdout:399: done (0 left) 2024-09-18T10:32:26.756 INFO:tasks.rados.rados.0.smithi160.stderr:0 errors. 2024-09-18T10:32:26.756 INFO:tasks.rados.rados.0.smithi160.stderr: 2024-09-18T10:32:26.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:32:26.763 INFO:teuthology.orchestra.run.smithi063.stdout:osd.12: {} 2024-09-18T10:32:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-18T10:32:26.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-18T10:32:26.777+0000 7f853e4b9640 0 -- 172.21.15.63:0/2203055006 >> [v2:172.21.15.71:6824/32744,v1:172.21.15.71:6825/32744] conn(0x7f8538191ed0 msgr2=0x7f85381942b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-18T10:32:26.780 INFO:teuthology.orchestra.run.smithi063.stdout:osd.13: {} 2024-09-18T10:32:26.796 INFO:teuthology.orchestra.run.smithi063.stdout:osd.14: {} 2024-09-18T10:32:26.797 INFO:teuthology.orchestra.run.smithi063.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-18T10:32:26.804 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:26.803+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:26.812 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-18T10:32:26.812 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-18T10:32:26.813 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-18T10:32:26.813 INFO:teuthology.orchestra.run.smithi063.stdout:osd.15: {} 2024-09-18T10:32:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-18T10:32:26.848 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:26.848 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:26.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-18T10:32:26.905 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:26.904+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:26.961 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-18T10:32:27.006 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-09-18T10:32:27.005+0000 7fcc235f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33030) UID: 0 2024-09-18T10:32:27.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:32:27.037 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":102,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:32:26.709028+0000","last_up_change":"2024-09-18T10:32:21.600101+0000","last_in_change":"2024-09-18T10:32:01.692062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-09-18T10:31:17.263911+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":67,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":0,"weight":0,"primary_affinity":0.0227203369140625,"last_clean_begin":22,"last_clean_end":73,"up_from":97,"up_thru":26,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":44795},{"type":"v1","addr":"172.21.15.71:6810","nonce":44795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":44795},{"type":"v1","addr":"172.21.15.71:6814","nonce":44795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":44795},{"type":"v1","addr":"172.21.15.71:6822","nonce":44795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":44795},{"type":"v1","addr":"172.21.15.71:6818","nonce":44795}]},"public_addr":"172.21.15.71:6810/44795","cluster_addr":"172.21.15.71:6814/44795","heartbeat_back_addr":"172.21.15.71:6822/44795","heartbeat_front_addr":"172.21.15.71:6818/44795","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:25.978869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.001886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:13.053079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.155220+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.605168+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:06.953638+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:04.067522+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:03.953892+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.963660+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":65536,"last_purged_snaps_scrub":"2024-09-18T10:32:23.553273+0000","dead_epoch":76},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.057952+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:00.977419+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:30:58.024718+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:14.175367+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:20.147292+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:17.297466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":55,"length":2},{"begin":59,"length":2}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":56,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:32:27.049 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:32:27.058 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.059 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-18T10:32:27.107 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:27.106+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:27.166 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.166 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-18T10:32:27.208 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:27.207+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:27.271 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.271 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.280 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-18T10:32:27.309 INFO:tasks.ceph.osd.11.smithi160.stderr:2024-09-18T10:32:27.308+0000 7f1fd4df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33046) UID: 0 2024-09-18T10:32:27.330 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:32:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:32:27.340 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-18T10:32:26.720500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":120226355,"num_objects":71,"num_object_clones":25,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":1,"num_read":522,"num_read_kb":259163,"num_write":1007,"num_write_kb":165090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":27443200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1237,"ondisk_log_size":1237,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":4710956,"kb_used_data":221432,"kb_used_omap":24,"kb_used_meta":4489255,"kb_avail":1410866644,"statfs":{"total":1449551462400,"available":1444727443456,"internally_reserved":0,"allocated":226746368,"data_stored":335678594,"data_compressed":3497340,"data_compressed_allocated":4845568,"data_compressed_original":10584064,"omap_allocated":25560,"internal_metadata":4596997160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2703360,"num_objects":8,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":18440,"num_write":17,"num_write_kb":2640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026364"},"pg_stats":[{"pgid":"3.f","version":"97'110","reported_seq":320,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.721536+0000","last_change":"2024-09-18T10:32:25.722335+0000","last_active":"2024-09-18T10:32:25.721536+0000","last_peered":"2024-09-18T10:32:25.721536+0000","last_clean":"2024-09-18T10:32:25.721536+0000","last_became_active":"2024-09-18T10:31:19.653467+0000","last_became_peered":"2024-09-18T10:31:19.653467+0000","last_unstale":"2024-09-18T10:32:25.721536+0000","last_undegraded":"2024-09-18T10:32:25.721536+0000","last_fullsized":"2024-09-18T10:32:25.721536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.811199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078906749999999998,"stat_sum":{"num_bytes":7651328,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":8800,"num_write":87,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3,15,14,2,11,0],"acting":[13,3,15,14,2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.e","version":"101'51","reported_seq":262,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.715732+0000","last_change":"2024-09-18T10:32:25.716627+0000","last_active":"2024-09-18T10:32:25.715732+0000","last_peered":"2024-09-18T10:32:25.715732+0000","last_clean":"2024-09-18T10:32:25.715732+0000","last_became_active":"2024-09-18T10:31:19.655410+0000","last_became_peered":"2024-09-18T10:31:19.655410+0000","last_unstale":"2024-09-18T10:32:25.715732+0000","last_undegraded":"2024-09-18T10:32:25.715732+0000","last_fullsized":"2024-09-18T10:32:25.715732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.418469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055889959999999997,"stat_sum":{"num_bytes":6553600,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":7928,"num_write":45,"num_write_kb":6544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,14,6,13,8,3,12],"acting":[11,14,6,13,8,3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.d","version":"101'41","reported_seq":265,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.722314+0000","last_change":"2024-09-18T10:32:25.725364+0000","last_active":"2024-09-18T10:32:25.722314+0000","last_peered":"2024-09-18T10:32:25.722314+0000","last_clean":"2024-09-18T10:32:25.722314+0000","last_became_active":"2024-09-18T10:32:02.609418+0000","last_became_peered":"2024-09-18T10:32:02.609418+0000","last_unstale":"2024-09-18T10:32:25.722314+0000","last_undegraded":"2024-09-18T10:32:25.722314+0000","last_fullsized":"2024-09-18T10:32:25.722314+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:46.743072+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.011021879,"stat_sum":{"num_bytes":2605056,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":2544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":32768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,11,15,7,8,4],"acting":[13,1,11,15,7,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.c","version":"101'92","reported_seq":306,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.730356+0000","last_change":"2024-09-18T10:32:25.730957+0000","last_active":"2024-09-18T10:32:25.730356+0000","last_peered":"2024-09-18T10:32:25.730356+0000","last_clean":"2024-09-18T10:32:25.730356+0000","last_became_active":"2024-09-18T10:31:19.654704+0000","last_became_peered":"2024-09-18T10:31:19.654704+0000","last_unstale":"2024-09-18T10:32:25.730356+0000","last_undegraded":"2024-09-18T10:32:25.730356+0000","last_fullsized":"2024-09-18T10:32:25.730356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:40.031783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011595141999999999,"stat_sum":{"num_bytes":12615680,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":14542,"num_write":66,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,3,7,12,14],"acting":[5,8,13,3,7,12,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.b","version":"98'116","reported_seq":349,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.510256+0000","last_change":"2024-09-18T10:32:24.510105+0000","last_active":"2024-09-18T10:32:24.510256+0000","last_peered":"2024-09-18T10:32:24.510256+0000","last_clean":"2024-09-18T10:32:24.510256+0000","last_became_active":"2024-09-18T10:31:19.659120+0000","last_became_peered":"2024-09-18T10:31:19.659120+0000","last_unstale":"2024-09-18T10:32:24.510256+0000","last_undegraded":"2024-09-18T10:32:24.510256+0000","last_fullsized":"2024-09-18T10:32:24.510256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'116","last_scrub_stamp":"2024-09-18T10:32:24.509962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.509962+0000","objects_scrubbed":7,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:44.832816+0000","scrub_duration":0.0049491040000000002,"objects_trimmed":0,"snaptrim_duration":0.0082503260000000005,"stat_sum":{"num_bytes":11780096,"num_objects":7,"num_object_clones":2,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":51,"num_read_kb":41302,"num_write":69,"num_write_kb":16672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,10,12,11,1,14],"acting":[4,0,10,12,11,1,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"1"}]},{"pgid":"3.a","version":"101'66","reported_seq":280,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.720365+0000","last_change":"2024-09-18T10:32:25.721447+0000","last_active":"2024-09-18T10:32:25.720365+0000","last_peered":"2024-09-18T10:32:25.720365+0000","last_clean":"2024-09-18T10:32:25.720365+0000","last_became_active":"2024-09-18T10:31:19.656939+0000","last_became_peered":"2024-09-18T10:31:19.656939+0000","last_unstale":"2024-09-18T10:32:25.720365+0000","last_undegraded":"2024-09-18T10:32:25.720365+0000","last_fullsized":"2024-09-18T10:32:25.720365+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.835368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0071725840000000001,"stat_sum":{"num_bytes":5996544,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":5545,"num_write":82,"num_write_kb":7824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,6,5,3,15,4],"acting":[13,1,6,5,3,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.9","version":"97'16","reported_seq":223,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.718359+0000","last_change":"2024-09-18T10:32:25.718831+0000","last_active":"2024-09-18T10:32:25.718359+0000","last_peered":"2024-09-18T10:32:25.718359+0000","last_clean":"2024-09-18T10:32:25.718359+0000","last_became_active":"2024-09-18T10:31:19.656490+0000","last_became_peered":"2024-09-18T10:31:19.656490+0000","last_unstale":"2024-09-18T10:32:25.718359+0000","last_undegraded":"2024-09-18T10:32:25.718359+0000","last_fullsized":"2024-09-18T10:32:25.718359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.159673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060310799999999999,"stat_sum":{"num_bytes":2523136,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":7396,"num_write":10,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,10,11,5,8,3],"acting":[7,2,10,11,5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.8","version":"98'25","reported_seq":253,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.714329+0000","last_change":"2024-09-18T10:32:25.714678+0000","last_active":"2024-09-18T10:32:25.714329+0000","last_peered":"2024-09-18T10:32:25.714329+0000","last_clean":"2024-09-18T10:32:25.714329+0000","last_became_active":"2024-09-18T10:31:19.656901+0000","last_became_peered":"2024-09-18T10:31:19.656901+0000","last_unstale":"2024-09-18T10:32:25.714329+0000","last_undegraded":"2024-09-18T10:32:25.714329+0000","last_fullsized":"2024-09-18T10:32:25.714329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'25","last_scrub_stamp":"2024-09-18T10:32:25.317885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:32:25.317885+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:37.266875+0000","scrub_duration":0.0043223330000000003,"objects_trimmed":0,"snaptrim_duration":0.00050270600000000001,"stat_sum":{"num_bytes":2965504,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":36344,"num_write":13,"num_write_kb":3424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,11,3,15,1,7],"acting":[6,0,11,3,15,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"1.0","version":"26'112","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.722922+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:32:24.722922+0000","last_peered":"2024-09-18T10:32:24.722922+0000","last_clean":"2024-09-18T10:32:24.722922+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:32:24.722922+0000","last_undegraded":"2024-09-18T10:32:24.722922+0000","last_fullsized":"2024-09-18T10:32:24.722922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:29.772412+0000","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":86,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.706643+0000","last_change":"2024-09-18T10:31:07.426813+0000","last_active":"2024-09-18T10:32:24.706643+0000","last_peered":"2024-09-18T10:32:24.706643+0000","last_clean":"2024-09-18T10:32:24.706643+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:32:24.706643+0000","last_undegraded":"2024-09-18T10:32:24.706643+0000","last_fullsized":"2024-09-18T10:32:24.706643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:33.235861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"101'21","reported_seq":223,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.720886+0000","last_change":"2024-09-18T10:32:25.721442+0000","last_active":"2024-09-18T10:32:25.720886+0000","last_peered":"2024-09-18T10:32:25.720886+0000","last_clean":"2024-09-18T10:32:25.720886+0000","last_became_active":"2024-09-18T10:31:19.656832+0000","last_became_peered":"2024-09-18T10:31:19.656832+0000","last_unstale":"2024-09-18T10:32:25.720886+0000","last_undegraded":"2024-09-18T10:32:25.720886+0000","last_fullsized":"2024-09-18T10:32:25.720886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:45.003864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072870330000000001,"stat_sum":{"num_bytes":2293760,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3,13,1,5,10,7],"acting":[14,3,13,1,5,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.315825+0000","last_change":"2024-09-18T10:32:12.279357+0000","last_active":"2024-09-18T10:32:25.315825+0000","last_peered":"2024-09-18T10:32:25.315825+0000","last_clean":"2024-09-18T10:32:25.315825+0000","last_became_active":"2024-09-18T10:32:02.608268+0000","last_became_peered":"2024-09-18T10:32:02.608268+0000","last_unstale":"2024-09-18T10:32:25.315825+0000","last_undegraded":"2024-09-18T10:32:25.315825+0000","last_fullsized":"2024-09-18T10:32:25.315825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:24.475175+0000","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"97'79","reported_seq":304,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-18T10:32:23.697294+0000","last_change":"2024-09-18T10:32:21.617732+0000","last_active":"2024-09-18T10:32:23.697294+0000","last_peered":"2024-09-18T10:32:23.697294+0000","last_clean":"2024-09-18T10:32:23.697294+0000","last_became_active":"2024-09-18T10:31:19.657050+0000","last_became_peered":"2024-09-18T10:31:19.657050+0000","last_unstale":"2024-09-18T10:32:23.697294+0000","last_undegraded":"2024-09-18T10:32:23.697294+0000","last_fullsized":"2024-09-18T10:32:23.697294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:32.836363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0067722119999999997,"stat_sum":{"num_bytes":5668864,"num_objects":6,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":45,"num_read_kb":19602,"num_write":62,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,14,10,7,3,2],"acting":[4,13,14,10,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.706638+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:32:24.706638+0000","last_peered":"2024-09-18T10:32:24.706638+0000","last_clean":"2024-09-18T10:32:24.706638+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:32:24.706638+0000","last_undegraded":"2024-09-18T10:32:24.706638+0000","last_fullsized":"2024-09-18T10:32:24.706638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"101'138","reported_seq":400,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.726454+0000","last_change":"2024-09-18T10:32:25.727198+0000","last_active":"2024-09-18T10:32:25.726454+0000","last_peered":"2024-09-18T10:32:25.726454+0000","last_clean":"2024-09-18T10:32:25.726454+0000","last_became_active":"2024-09-18T10:32:02.608963+0000","last_became_peered":"2024-09-18T10:32:02.608963+0000","last_unstale":"2024-09-18T10:32:25.726454+0000","last_undegraded":"2024-09-18T10:32:25.726454+0000","last_fullsized":"2024-09-18T10:32:25.726454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'134","last_scrub_stamp":"2024-09-18T10:32:23.224218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.224218+0000","objects_scrubbed":9,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:49.121664+0000","scrub_duration":0.00361707,"objects_trimmed":0,"snaptrim_duration":0.010267303,"stat_sum":{"num_bytes":20480000,"num_objects":9,"num_object_clones":5,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":49362,"num_write":82,"num_write_kb":26896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":17481728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,2,6,15,4],"acting":[3,7,1,2,6,15,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"2.2","version":"29'2","reported_seq":97,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.710046+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:32:24.710046+0000","last_peered":"2024-09-18T10:32:24.710046+0000","last_clean":"2024-09-18T10:32:24.710046+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:32:24.710046+0000","last_undegraded":"2024-09-18T10:32:24.710046+0000","last_fullsized":"2024-09-18T10:32:24.710046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:12.407310+0000","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":216,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.712049+0000","last_change":"2024-09-18T10:32:25.712492+0000","last_active":"2024-09-18T10:32:25.712049+0000","last_peered":"2024-09-18T10:32:25.712049+0000","last_clean":"2024-09-18T10:32:25.712049+0000","last_became_active":"2024-09-18T10:32:02.600925+0000","last_became_peered":"2024-09-18T10:32:02.600925+0000","last_unstale":"2024-09-18T10:32:25.712049+0000","last_undegraded":"2024-09-18T10:32:25.712049+0000","last_fullsized":"2024-09-18T10:32:25.712049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:39.142050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058180999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,12,4,13,11,2,5],"acting":[10,12,4,13,11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"3.5","version":"96'52","reported_seq":292,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.719252+0000","last_change":"2024-09-18T10:32:25.719562+0000","last_active":"2024-09-18T10:32:25.719252+0000","last_peered":"2024-09-18T10:32:25.719252+0000","last_clean":"2024-09-18T10:32:25.719252+0000","last_became_active":"2024-09-18T10:32:02.603549+0000","last_became_peered":"2024-09-18T10:32:02.603549+0000","last_unstale":"2024-09-18T10:32:25.719252+0000","last_undegraded":"2024-09-18T10:32:25.719252+0000","last_fullsized":"2024-09-18T10:32:25.719252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.237217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059789399999999996,"stat_sum":{"num_bytes":3014656,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":3034,"num_write":27,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":491520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,2,12,0,11],"acting":[5,8,4,2,12,0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-18T10:32:23.697358+0000","last_change":"2024-09-18T10:32:15.506544+0000","last_active":"2024-09-18T10:32:23.697358+0000","last_peered":"2024-09-18T10:32:23.697358+0000","last_clean":"2024-09-18T10:32:23.697358+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:32:23.697358+0000","last_undegraded":"2024-09-18T10:32:23.697358+0000","last_fullsized":"2024-09-18T10:32:23.697358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.506457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:26.446339+0000","scrub_duration":0.0014457090000000001,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"101'69","reported_seq":276,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-18T10:32:25.723405+0000","last_change":"2024-09-18T10:32:25.724691+0000","last_active":"2024-09-18T10:32:25.723405+0000","last_peered":"2024-09-18T10:32:25.723405+0000","last_clean":"2024-09-18T10:32:25.723405+0000","last_became_active":"2024-09-18T10:31:19.653632+0000","last_became_peered":"2024-09-18T10:31:19.653632+0000","last_unstale":"2024-09-18T10:32:25.723405+0000","last_undegraded":"2024-09-18T10:32:25.723405+0000","last_fullsized":"2024-09-18T10:32:25.723405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:42.743288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075390479999999996,"stat_sum":{"num_bytes":2342912,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":6394,"num_write":48,"num_write_kb":7008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15,4,2,6,10,7],"acting":[8,15,4,2,6,10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.725280+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:32:24.725280+0000","last_peered":"2024-09-18T10:32:24.725280+0000","last_clean":"2024-09-18T10:32:24.725280+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:32:24.725280+0000","last_undegraded":"2024-09-18T10:32:24.725280+0000","last_fullsized":"2024-09-18T10:32:24.725280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"100'125","reported_seq":349,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.705612+0000","last_change":"2024-09-18T10:32:21.618088+0000","last_active":"2024-09-18T10:32:24.705612+0000","last_peered":"2024-09-18T10:32:24.705612+0000","last_clean":"2024-09-18T10:32:24.705612+0000","last_became_active":"2024-09-18T10:31:19.259917+0000","last_became_peered":"2024-09-18T10:31:19.259917+0000","last_unstale":"2024-09-18T10:32:24.705612+0000","last_undegraded":"2024-09-18T10:32:24.705612+0000","last_fullsized":"2024-09-18T10:32:24.705612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:44.414788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069707739999999999,"stat_sum":{"num_bytes":17154048,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":42588,"num_write":98,"num_write_kb":21744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,0,14,10,13],"acting":[4,11,6,0,14,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.722890+0000","last_change":"2024-09-18T10:31:07.643789+0000","last_active":"2024-09-18T10:32:24.722890+0000","last_peered":"2024-09-18T10:32:24.722890+0000","last_clean":"2024-09-18T10:32:24.722890+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:32:24.722890+0000","last_undegraded":"2024-09-18T10:32:24.722890+0000","last_fullsized":"2024-09-18T10:32:24.722890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:31:04.163714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.102222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"96'121","reported_seq":384,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.506573+0000","last_change":"2024-09-18T10:32:21.620002+0000","last_active":"2024-09-18T10:32:24.506573+0000","last_peered":"2024-09-18T10:32:24.506573+0000","last_clean":"2024-09-18T10:32:24.506573+0000","last_became_active":"2024-09-18T10:32:02.606189+0000","last_became_peered":"2024-09-18T10:32:02.606189+0000","last_unstale":"2024-09-18T10:32:24.506573+0000","last_undegraded":"2024-09-18T10:32:24.506573+0000","last_fullsized":"2024-09-18T10:32:24.506573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:18.229845+0000","last_clean_scrub_stamp":"2024-09-18T10:31:18.229845+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:26.567612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066022599999999998,"stat_sum":{"num_bytes":15990784,"num_objects":8,"num_object_clones":2,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":16248,"num_write":123,"num_write_kb":17936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":9437184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14,6,2,5,3,15],"acting":[0,14,6,2,5,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"37","length":"1"},{"start":"3b","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-18T10:32:24.710197+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:32:24.710197+0000","last_peered":"2024-09-18T10:32:24.710197+0000","last_clean":"2024-09-18T10:32:24.710197+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:32:24.710197+0000","last_undegraded":"2024-09-18T10:32:24.710197+0000","last_fullsized":"2024-09-18T10:32:24.710197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:35.877334+0000","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":119635968,"num_objects":67,"num_object_clones":25,"num_object_copies":469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":1,"num_read":436,"num_read_kb":259090,"num_write":860,"num_write_kb":162416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":27443200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":213958656,"data_stored":324952064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1139,"internal_metadata":0},"log_size":1122,"ondisk_log_size":1122,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280531,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316888,"kb_used_data":15364,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94054952,"statfs":{"total":96636764160,"available":96312270848,"internally_reserved":0,"allocated":15732736,"data_stored":22915120,"data_compressed":245397,"data_compressed_allocated":356352,"data_compressed_original":1159168,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41899999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.436}]},{"osd":5,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.502},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.49099999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.56200000000000006}]},{"osd":7,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53500000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.60599999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.629}]}]},{"osd":14,"up_from":22,"seq":94489280532,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322124,"kb_used_data":20604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94049716,"statfs":{"total":96636764160,"available":96306909184,"internally_reserved":0,"allocated":21098496,"data_stored":29845008,"data_compressed":235472,"data_compressed_allocated":323584,"data_compressed_original":647168,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.438},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.52600000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51700000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.63600000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.67900000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66500000000000004}]}]},{"osd":13,"up_from":22,"seq":94489280532,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317436,"kb_used_data":15916,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94054404,"statfs":{"total":96636764160,"available":96311709696,"internally_reserved":0,"allocated":16297984,"data_stored":24042990,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.504}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.623}]},{"osd":5,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.74099999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.72999999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.75},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77900000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.84699999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.85699999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.76600000000000001}]},{"osd":15,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.872}]}]},{"osd":0,"up_from":21,"seq":90194313236,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312788,"kb_used_data":15428,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94059052,"statfs":{"total":96636764160,"available":96316469248,"internally_reserved":0,"allocated":15798272,"data_stored":19418587,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.626}]},{"osd":6,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.75}]},{"osd":7,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.318},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.39100000000000001}]},{"osd":8,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.375},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.59399999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.46800000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65900000000000003}]},{"osd":15,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.54500000000000004}]}]},{"osd":1,"up_from":21,"seq":90194313237,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309728,"kb_used_data":12368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94062112,"statfs":{"total":96636764160,"available":96319602688,"internally_reserved":0,"allocated":12664832,"data_stored":20159919,"data_compressed":226365,"data_compressed_allocated":311296,"data_compressed_original":622592,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.46400000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.433},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.313}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.502},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.49199999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40000000000000002}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.48499999999999999}]}]},{"osd":4,"up_from":21,"seq":90194313237,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319420,"kb_used_data":17896,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94052420,"statfs":{"total":96636764160,"available":96309678080,"internally_reserved":0,"allocated":18325504,"data_stored":26154462,"data_compressed":229404,"data_compressed_allocated":315392,"data_compressed_original":630784,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.34399999999999997}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.85299999999999998}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.94999999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.52800000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.79800000000000004}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72899999999999998}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.66500000000000004}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.876}]},{"osd":15,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.89900000000000002}]}]},{"osd":2,"up_from":22,"seq":94489280532,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312572,"kb_used_data":15212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94059268,"statfs":{"total":96636764160,"available":96316690432,"internally_reserved":0,"allocated":15577088,"data_stored":23010779,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.311},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.29299999999999998}]},{"osd":4,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.503},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.436}]},{"osd":6,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.247},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.32600000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.35299999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49099999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":12,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.57199999999999995}]},{"osd":13,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.47099999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280532,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322844,"kb_used_data":21320,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94048996,"statfs":{"total":96636764160,"available":96306171904,"internally_reserved":0,"allocated":21831680,"data_stored":33756638,"data_compressed":229404,"data_compressed_allocated":315392,"data_compressed_original":630784,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,6,7,8,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.373},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.30399999999999999}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.438},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45900000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.41699999999999998}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.55900000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45000000000000001}]}]},{"osd":5,"up_from":22,"seq":94489280531,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308852,"kb_used_data":11492,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94062988,"statfs":{"total":96636764160,"available":96320499712,"internally_reserved":0,"allocated":11767808,"data_stored":17231323,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.626}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.747},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.76000000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41799999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.72399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.58699999999999997}]},{"osd":12,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.54000000000000004}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.49299999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.66600000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.56100000000000005}]}]},{"osd":6,"up_from":22,"seq":94489280531,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320156,"kb_used_data":18636,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94051684,"statfs":{"total":96636764160,"available":96308924416,"internally_reserved":0,"allocated":19083264,"data_stored":26349563,"data_compressed":242366,"data_compressed_allocated":352256,"data_compressed_original":1150976,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.376},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.35399999999999998}]},{"osd":1,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.55100000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.622},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.72499999999999998}]},{"osd":7,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.61299999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.45000000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77500000000000002}]},{"osd":14,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.52700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.69499999999999995}]}]},{"osd":7,"up_from":22,"seq":94489280532,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311064,"kb_used_data":13704,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94060776,"statfs":{"total":96636764160,"available":96318234624,"internally_reserved":0,"allocated":14032896,"data_stored":24219099,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.626},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40200000000000002}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.72099999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51100000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.749}]},{"osd":11,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.64700000000000002}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.76300000000000001}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78300000000000003}]}]},{"osd":8,"up_from":22,"seq":94489280533,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305728,"kb_used_data":8372,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94066112,"statfs":{"total":96636764160,"available":96323698688,"internally_reserved":0,"allocated":8572928,"data_stored":15969755,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.57399999999999995}]},{"osd":7,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66500000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.65300000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.68200000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.77600000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.753},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.78700000000000003}]}]},{"osd":9,"up_from":0,"seq":416611827714,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":10,"up_from":22,"seq":94489280532,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308688,"kb_used_data":11328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94063152,"statfs":{"total":96636764160,"available":96320667648,"internally_reserved":0,"allocated":11599872,"data_stored":15003099,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.23599999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34599999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.374}]},{"osd":5,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54200000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":11,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.40699999999999997}]},{"osd":12,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52300000000000002}]},{"osd":14,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.44}]},{"osd":15,"last update":"Wed Sep 18 10:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53100000000000003}]}]},{"osd":11,"up_from":22,"seq":94489280531,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315896,"kb_used_data":14376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94055944,"statfs":{"total":96636764160,"available":96313286656,"internally_reserved":0,"allocated":14721024,"data_stored":21110235,"data_compressed":232441,"data_compressed_allocated":319488,"data_compressed_original":638976,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.72399999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.69499999999999995}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59699999999999998}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66100000000000003}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73499999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.68000000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.70999999999999996}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.754}]}]},{"osd":12,"up_from":22,"seq":94489280532,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306772,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94065068,"statfs":{"total":96636764160,"available":96322629632,"internally_reserved":0,"allocated":9641984,"data_stored":16492017,"data_compressed":229404,"data_compressed_allocated":315392,"data_compressed_original":630784,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.32900000000000001}]},{"osd":1,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.374}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.61499999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69599999999999995}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.57799999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.495}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.624},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14639104,"data_stored":18558976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11530240,"data_stored":19320832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14417920,"data_stored":22151168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20684800,"data_stored":32907264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17260544,"data_stored":25890816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10608640,"data_stored":16371712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17870848,"data_stored":24961024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12873728,"data_stored":22769664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":7413760,"data_stored":14520320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":4968448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1139,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":10440704,"data_stored":14143488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":13561856,"data_stored":19660800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":8491008,"data_stored":15642624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":15134720,"data_stored":22593536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":19927040,"data_stored":28975104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":21516288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:32:27.346 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-18T10:32:27.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-18T10:32:27.377 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.378 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-18T10:32:27.436 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-18T10:32:27.435+0000 7f6e67df8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33026) UID: 0 2024-09-18T10:32:27.500 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.500 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-18T10:32:27.510 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:27.509+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:27.611 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:27.610+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:27.650 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.650 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-18T10:32:27.713 INFO:tasks.ceph.osd.13.smithi071.stderr:2024-09-18T10:32:27.712+0000 7f9bfe5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 32739) UID: 0 2024-09-18T10:32:27.728 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-18T10:32:27.759 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.759 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-18T10:32:27.813 INFO:tasks.ceph.osd.10.smithi100.stderr:2024-09-18T10:32:27.812+0000 7f2a9bdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 33031) UID: 0 2024-09-18T10:32:27.865 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:27.866 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:27.875 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-18T10:32:27.914 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-18T10:32:27.913+0000 7fae751f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33043) UID: 0 2024-09-18T10:32:28.015 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.015 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.015 INFO:tasks.ceph.osd.9.smithi071.stderr:2024-09-18T10:32:28.015+0000 7feecfdf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 44790) UID: 0 2024-09-18T10:32:28.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-18T10:32:28.116 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:28.115+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:28.121 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.121 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-18T10:32:28.217 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:28.217+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:28.268 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.268 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-18T10:32:28.318 INFO:tasks.ceph.osd.15.smithi160.stderr:2024-09-18T10:32:28.317+0000 7f8b779f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33048) UID: 0 2024-09-18T10:32:28.373 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.373 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-18T10:32:28.419 INFO:tasks.ceph.osd.8.smithi063.stderr:2024-09-18T10:32:28.419+0000 7f0aecbf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33463) UID: 0 2024-09-18T10:32:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.479 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-18T10:32:28.531 INFO:tasks.ceph.osd.14.smithi100.stderr:2024-09-18T10:32:28.530+0000 7f22fb5f8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 33034) UID: 0 2024-09-18T10:32:28.585 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.585 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-18T10:32:28.598 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'unique_pool_0' removed 2024-09-18T10:32:28.598 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-18T10:32:28.615 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-18T10:32:28.629 INFO:tasks.thrashosds:joining thrashosds 2024-09-18T10:32:28.731 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.732 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-18T10:32:28.838 INFO:teuthology.orchestra.run.smithi100.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.838 INFO:teuthology.orchestra.run.smithi100.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.847 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-18T10:32:28.957 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:28.957 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:28.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-18T10:32:29.065 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.065 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.073 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-18T10:32:29.171 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.171 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.179 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-18T10:32:29.280 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.280 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.288 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-18T10:32:29.385 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.385 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.394 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-18T10:32:29.491 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.491 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-18T10:32:29.598 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.598 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.608 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-18T10:32:29.707 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.707 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.716 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-18T10:32:29.813 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.814 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-18T10:32:29.919 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:29.920 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:29.928 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-18T10:32:30.026 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:30.026 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:30.034 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-18T10:32:30.131 INFO:teuthology.orchestra.run.smithi160.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:30.131 INFO:teuthology.orchestra.run.smithi160.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:30.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-18T10:32:30.252 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:30.253 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:30.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-18T10:32:30.365 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:30.365 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:30.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-18T10:32:30.473 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-09-18T10:32:30.473 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-18T10:32:30.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-18T10:32:31.730 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-18T10:32:31.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-18T10:32:31.822 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-18T10:32:31.822 INFO:tasks.thrashosds.thrasher:Adding osd 9 2024-09-18T10:32:31.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 9 2024-09-18T10:32:32.113 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-18T10:32:32.111+0000 7f508ddf1640 -1 mon.a@0(leader).osd e105 definitely_dead 0 2024-09-18T10:32:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-18T10:32:32.744 INFO:teuthology.orchestra.run.smithi063.stderr:marked in osd.9. 2024-09-18T10:32:32.760 INFO:tasks.thrashosds.thrasher:Added osd 9 2024-09-18T10:32:32.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-18T10:32:32.918 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a: {} 2024-09-18T10:32:32.918 INFO:teuthology.orchestra.run.smithi063.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T10:32:32.927 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b: {} 2024-09-18T10:32:32.927 INFO:teuthology.orchestra.run.smithi063.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T10:32:32.937 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c: {} 2024-09-18T10:32:32.937 INFO:teuthology.orchestra.run.smithi063.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-18T10:32:32.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-18T10:32:33.749 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.0 to 1 (10000) 2024-09-18T10:32:33.764 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-18T10:32:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-18T10:32:34.769 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-18T10:32:35.756 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.4 to 1 (10000) 2024-09-18T10:32:35.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-18T10:32:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-18T10:32:36.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-18T10:32:37.776 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.8 to 1 (10000) 2024-09-18T10:32:37.792 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-09-18T10:32:38.782 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-09-18T10:32:38.797 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-18T10:32:39.791 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.12 to 1 (10000) 2024-09-18T10:32:39.808 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 12 1 2024-09-18T10:32:40.796 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.12 primary-affinity to 1 (8655362) 2024-09-18T10:32:40.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-18T10:32:41.801 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 1 (10000) 2024-09-18T10:32:41.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-18T10:32:42.807 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-18T10:32:42.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-18T10:32:43.813 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.5 to 1 (10000) 2024-09-18T10:32:43.829 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-18T10:32:44.819 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-18T10:32:44.834 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-18T10:32:45.824 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.13 to 1 (10000) 2024-09-18T10:32:45.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 1 2024-09-18T10:32:46.828 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.13 primary-affinity to 1 (8655362) 2024-09-18T10:32:46.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-18T10:32:47.836 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.2 to 1 (10000) 2024-09-18T10:32:47.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-18T10:32:48.841 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-18T10:32:48.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-18T10:32:49.849 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.6 to 1 (10000) 2024-09-18T10:32:49.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-18T10:32:50.856 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-18T10:32:50.873 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-18T10:32:51.865 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.10 to 1 (10000) 2024-09-18T10:32:51.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 10 1 2024-09-18T10:32:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-09-18T10:32:52.889 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-18T10:32:53.881 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.14 to 1 (10000) 2024-09-18T10:32:53.897 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 1 2024-09-18T10:32:54.887 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.14 primary-affinity to 1 (8655362) 2024-09-18T10:32:54.902 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-18T10:32:55.892 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.3 to 1 (10000) 2024-09-18T10:32:55.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-18T10:32:56.897 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-18T10:32:56.914 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-18T10:32:57.902 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.7 to 1 (10000) 2024-09-18T10:32:57.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-18T10:32:58.908 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-18T10:32:58.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-18T10:32:59.913 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.11 to 1 (10000) 2024-09-18T10:32:59.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 1 2024-09-18T10:33:00.918 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-09-18T10:33:00.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-18T10:33:01.923 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.15 to 1 (10000) 2024-09-18T10:33:01.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-09-18T10:33:02.928 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-09-18T10:33:02.943 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-18T10:33:03.937 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.9 to 1 (10000) 2024-09-18T10:33:03.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 1 2024-09-18T10:33:04.942 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-09-18T10:33:04.959 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-18T10:33:04.959 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-18T10:33:04.959 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-18T10:33:04.959 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-18T10:33:04.959 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-18T10:33:04.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:33:05.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:05.243 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":138,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:33:04.937895+0000","last_up_change":"2024-09-18T10:32:21.600101+0000","last_in_change":"2024-09-18T10:32:32.732978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":73,"up_from":97,"up_thru":26,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":44795},{"type":"v1","addr":"172.21.15.71:6810","nonce":44795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":44795},{"type":"v1","addr":"172.21.15.71:6814","nonce":44795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":44795},{"type":"v1","addr":"172.21.15.71:6822","nonce":44795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":44795},{"type":"v1","addr":"172.21.15.71:6818","nonce":44795}]},"public_addr":"172.21.15.71:6810/44795","cluster_addr":"172.21.15.71:6814/44795","heartbeat_back_addr":"172.21.15.71:6822/44795","heartbeat_front_addr":"172.21.15.71:6818/44795","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:25.978869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.001886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:13.053079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.155220+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.605168+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:06.953638+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:04.067522+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:03.953892+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.963660+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:23.553273+0000","dead_epoch":76},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:27.998906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:00.977419+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:26.791355+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:14.175367+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:20.147292+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:17.297466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":56,"length":1},{"begin":60,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:33:05.256 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-18T10:33:05.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:33:05.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:05.531 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":138,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:33:04.937895+0000","last_up_change":"2024-09-18T10:32:21.600101+0000","last_in_change":"2024-09-18T10:32:32.732978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":73,"up_from":97,"up_thru":26,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":44795},{"type":"v1","addr":"172.21.15.71:6810","nonce":44795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":44795},{"type":"v1","addr":"172.21.15.71:6814","nonce":44795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":44795},{"type":"v1","addr":"172.21.15.71:6822","nonce":44795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":44795},{"type":"v1","addr":"172.21.15.71:6818","nonce":44795}]},"public_addr":"172.21.15.71:6810/44795","cluster_addr":"172.21.15.71:6814/44795","heartbeat_back_addr":"172.21.15.71:6822/44795","heartbeat_front_addr":"172.21.15.71:6818/44795","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:25.978869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.001886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:13.053079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.155220+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.605168+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:06.953638+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:04.067522+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:03.953892+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.963660+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:23.553273+0000","dead_epoch":76},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:27.998906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:00.977419+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:26.791355+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:14.175367+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:20.147292+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:17.297466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":56,"length":1},{"begin":60,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:33:05.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-18T10:33:05.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-18T10:33:05.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-18T10:33:05.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-18T10:33:05.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-18T10:33:05.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-18T10:33:05.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-18T10:33:05.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-18T10:33:05.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-18T10:33:05.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-18T10:33:05.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-18T10:33:05.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-18T10:33:05.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-18T10:33:05.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-18T10:33:05.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-18T10:33:05.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-18T10:33:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:90194313245 2024-09-18T10:33:05.957 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T10:33:05.994 INFO:teuthology.orchestra.run.smithi063.stdout:416611827722 2024-09-18T10:33:05.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-18T10:33:05.996 INFO:teuthology.orchestra.run.smithi063.stdout:90194313246 2024-09-18T10:33:05.996 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-18T10:33:06.004 INFO:teuthology.orchestra.run.smithi063.stdout:94489280539 2024-09-18T10:33:06.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-18T10:33:06.005 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:06.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-18T10:33:06.009 INFO:teuthology.orchestra.run.smithi063.stdout:94489280539 2024-09-18T10:33:06.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-18T10:33:06.014 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:06.014 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-18T10:33:06.021 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:06.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-18T10:33:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:06.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-18T10:33:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:06.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-18T10:33:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:06.031 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-18T10:33:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:06.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-18T10:33:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:94489280539 2024-09-18T10:33:06.046 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-18T10:33:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:94489280539 2024-09-18T10:33:06.081 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-18T10:33:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:90194313246 2024-09-18T10:33:06.156 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-18T10:33:06.246 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:06.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-18T10:33:06.873 INFO:teuthology.orchestra.run.smithi063.stdout:90194313243 2024-09-18T10:33:06.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313245 got 90194313243 for osd.0 2024-09-18T10:33:06.927 INFO:teuthology.orchestra.run.smithi063.stdout:94489280539 2024-09-18T10:33:06.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280539 for osd.12 2024-09-18T10:33:07.041 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:07.047 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:07.049 INFO:teuthology.orchestra.run.smithi063.stdout:94489280542 2024-09-18T10:33:07.052 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:07.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280541 for osd.10 2024-09-18T10:33:07.077 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280540 for osd.11 2024-09-18T10:33:07.084 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.088 INFO:teuthology.orchestra.run.smithi063.stdout:416611827723 2024-09-18T10:33:07.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280541 for osd.7 2024-09-18T10:33:07.092 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280541 got 94489280542 for osd.8 2024-09-18T10:33:07.093 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.105 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:07.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 416611827722 got 416611827723 for osd.9 2024-09-18T10:33:07.147 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.151 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:07.151 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:07.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280540 for osd.6 2024-09-18T10:33:07.152 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.158 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:07.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280541 for osd.3 2024-09-18T10:33:07.171 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280541 for osd.2 2024-09-18T10:33:07.172 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:07.172 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280541 for osd.13 2024-09-18T10:33:07.180 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280540 for osd.5 2024-09-18T10:33:07.186 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.205 INFO:teuthology.orchestra.run.smithi063.stdout:90194313246 2024-09-18T10:33:07.208 INFO:teuthology.orchestra.run.smithi063.stdout:90194313246 2024-09-18T10:33:07.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313246 got 90194313246 for osd.1 2024-09-18T10:33:07.219 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313246 got 90194313246 for osd.4 2024-09-18T10:33:07.228 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:07.228 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.232 INFO:teuthology.orchestra.run.smithi063.stdout:94489280540 2024-09-18T10:33:07.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280541 got 94489280541 for osd.14 2024-09-18T10:33:07.241 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280539 got 94489280540 for osd.15 2024-09-18T10:33:07.246 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:07.915 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-18T10:33:07.963 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-18T10:33:08.213 INFO:teuthology.orchestra.run.smithi063.stdout:90194313245 2024-09-18T10:33:08.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313245 got 90194313245 for osd.0 2024-09-18T10:33:08.227 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:08.248 INFO:teuthology.orchestra.run.smithi063.stdout:94489280541 2024-09-18T10:33:08.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280540 got 94489280541 for osd.12 2024-09-18T10:33:08.261 DEBUG:teuthology.parallel:result is None 2024-09-18T10:33:08.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-18T10:33:08.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:08.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:08.583 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:08.593 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-18T10:33:06.637568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4825408,"kb_used_data":25500,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505124032,"statfs":{"total":1546188226560,"available":1541247008768,"internally_reserved":0,"allocated":26112000,"data_stored":20576484,"data_compressed":5554709,"data_compressed_allocated":7639040,"data_compressed_original":16171008,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000932"},"pg_stats":[{"pgid":"1.0","version":"26'112","reported_seq":264,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936133+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:33:03.936133+0000","last_peered":"2024-09-18T10:33:03.936133+0000","last_clean":"2024-09-18T10:33:03.936133+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:03.936133+0000","last_undegraded":"2024-09-18T10:33:03.936133+0000","last_fullsized":"2024-09-18T10:33:03.936133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:29.772412+0000","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":131,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777495+0000","last_change":"2024-09-18T10:32:35.935490+0000","last_active":"2024-09-18T10:33:05.777495+0000","last_peered":"2024-09-18T10:33:05.777495+0000","last_clean":"2024-09-18T10:33:05.777495+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:05.777495+0000","last_undegraded":"2024-09-18T10:33:05.777495+0000","last_fullsized":"2024-09-18T10:33:05.777495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-18T10:32:35.935394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:35.935394+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:50.624982+0000","scrub_duration":0.0020068159999999998,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.096359+0000","last_change":"2024-09-18T10:33:06.096359+0000","last_active":"2024-09-18T10:33:06.096359+0000","last_peered":"2024-09-18T10:33:06.096359+0000","last_clean":"2024-09-18T10:33:06.096359+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:06.096359+0000","last_undegraded":"2024-09-18T10:33:06.096359+0000","last_fullsized":"2024-09-18T10:33:06.096359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.667737+0000","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777489+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:33:05.777489+0000","last_peered":"2024-09-18T10:33:05.777489+0000","last_clean":"2024-09-18T10:33:05.777489+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:05.777489+0000","last_undegraded":"2024-09-18T10:33:05.777489+0000","last_fullsized":"2024-09-18T10:33:05.777489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":134,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936116+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:33:03.936116+0000","last_peered":"2024-09-18T10:33:03.936116+0000","last_clean":"2024-09-18T10:33:03.936116+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:03.936116+0000","last_undegraded":"2024-09-18T10:33:03.936116+0000","last_fullsized":"2024-09-18T10:33:03.936116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:12.407310+0000","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":131,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936105+0000","last_change":"2024-09-18T10:32:15.506544+0000","last_active":"2024-09-18T10:33:03.936105+0000","last_peered":"2024-09-18T10:33:03.936105+0000","last_clean":"2024-09-18T10:33:03.936105+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:03.936105+0000","last_undegraded":"2024-09-18T10:33:03.936105+0000","last_fullsized":"2024-09-18T10:33:03.936105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.506457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:26.446339+0000","scrub_duration":0.0014457090000000001,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.942315+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:33:03.942315+0000","last_peered":"2024-09-18T10:33:03.942315+0000","last_clean":"2024-09-18T10:33:03.942315+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:03.942315+0000","last_undegraded":"2024-09-18T10:33:03.942315+0000","last_fullsized":"2024-09-18T10:33:03.942315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:04.994379+0000","last_change":"2024-09-18T10:32:28.167569+0000","last_active":"2024-09-18T10:33:04.994379+0000","last_peered":"2024-09-18T10:33:04.994379+0000","last_clean":"2024-09-18T10:33:04.994379+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:04.994379+0000","last_undegraded":"2024-09-18T10:33:04.994379+0000","last_fullsized":"2024-09-18T10:33:04.994379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:28.167496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:28.167496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:42.920405+0000","scrub_duration":0.001229918,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936131+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:33:03.936131+0000","last_peered":"2024-09-18T10:33:03.936131+0000","last_clean":"2024-09-18T10:33:03.936131+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:03.936131+0000","last_undegraded":"2024-09-18T10:33:03.936131+0000","last_fullsized":"2024-09-18T10:33:03.936131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:35.877334+0000","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303160,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068680,"statfs":{"total":96636764160,"available":96326328320,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.62},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.87}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.91200000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.89100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.753},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82099999999999995}]}]},{"osd":14,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.437},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.78500000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55600000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.72799999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77100000000000002}]}]},{"osd":13,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1634304,"data_stored":1224095,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79500000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69799999999999995}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.90700000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.86499999999999999}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.88600000000000001}]}]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.81100000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":0.76500000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69899999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.82399999999999995}]}]},{"osd":1,"up_from":21,"seq":90194313246,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.376}]},{"osd":5,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.748},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.45700000000000002}]}]},{"osd":4,"up_from":21,"seq":90194313246,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":2.6240000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":2.028},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":2.7450000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":2.698},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":2.0819999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":2.774}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.998}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.966}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":2.665}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":2.1099999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.5},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67200000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.748},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85999999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70599999999999996}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84199999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.96399999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.94399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.749},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.80400000000000005}]}]},{"osd":5,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66300000000000003}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.72799999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50800000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71799999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.78800000000000003}]}]},{"osd":6,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.64300000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58799999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]},{"osd":14,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81000000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.97699999999999998}]}]},{"osd":7,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.27400000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.433}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56200000000000006}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58399999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55100000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69999999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.628},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]}]},{"osd":8,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.625}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.73199999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.871}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82699999999999996}]}]},{"osd":9,"up_from":97,"seq":416611827723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299536,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072304,"statfs":{"total":96636764160,"available":96330039296,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":10,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.92800000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.88800000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.871}]}]},{"osd":11,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.748}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59799999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68799999999999994}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55100000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63900000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88600000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1622016,"data_stored":1214577,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.65000000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.73999999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.67800000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.68999999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:08.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:08.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:08.924 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:08.935 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-18T10:33:08.637973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4825408,"kb_used_data":25500,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505124032,"statfs":{"total":1546188226560,"available":1541247008768,"internally_reserved":0,"allocated":26112000,"data_stored":20576484,"data_compressed":5554709,"data_compressed_allocated":7639040,"data_compressed_original":16171008,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711211"},"pg_stats":[{"pgid":"1.0","version":"26'112","reported_seq":264,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936133+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:33:03.936133+0000","last_peered":"2024-09-18T10:33:03.936133+0000","last_clean":"2024-09-18T10:33:03.936133+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:03.936133+0000","last_undegraded":"2024-09-18T10:33:03.936133+0000","last_fullsized":"2024-09-18T10:33:03.936133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:29.772412+0000","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":131,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777495+0000","last_change":"2024-09-18T10:32:35.935490+0000","last_active":"2024-09-18T10:33:05.777495+0000","last_peered":"2024-09-18T10:33:05.777495+0000","last_clean":"2024-09-18T10:33:05.777495+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:05.777495+0000","last_undegraded":"2024-09-18T10:33:05.777495+0000","last_fullsized":"2024-09-18T10:33:05.777495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-18T10:32:35.935394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:35.935394+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:50.624982+0000","scrub_duration":0.0020068159999999998,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.096359+0000","last_change":"2024-09-18T10:33:06.096359+0000","last_active":"2024-09-18T10:33:06.096359+0000","last_peered":"2024-09-18T10:33:06.096359+0000","last_clean":"2024-09-18T10:33:06.096359+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:06.096359+0000","last_undegraded":"2024-09-18T10:33:06.096359+0000","last_fullsized":"2024-09-18T10:33:06.096359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.667737+0000","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777489+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:33:05.777489+0000","last_peered":"2024-09-18T10:33:05.777489+0000","last_clean":"2024-09-18T10:33:05.777489+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:05.777489+0000","last_undegraded":"2024-09-18T10:33:05.777489+0000","last_fullsized":"2024-09-18T10:33:05.777489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":134,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936116+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:33:03.936116+0000","last_peered":"2024-09-18T10:33:03.936116+0000","last_clean":"2024-09-18T10:33:03.936116+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:03.936116+0000","last_undegraded":"2024-09-18T10:33:03.936116+0000","last_fullsized":"2024-09-18T10:33:03.936116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:12.407310+0000","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":131,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936105+0000","last_change":"2024-09-18T10:32:15.506544+0000","last_active":"2024-09-18T10:33:03.936105+0000","last_peered":"2024-09-18T10:33:03.936105+0000","last_clean":"2024-09-18T10:33:03.936105+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:03.936105+0000","last_undegraded":"2024-09-18T10:33:03.936105+0000","last_fullsized":"2024-09-18T10:33:03.936105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.506457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:26.446339+0000","scrub_duration":0.0014457090000000001,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.942315+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:33:03.942315+0000","last_peered":"2024-09-18T10:33:03.942315+0000","last_clean":"2024-09-18T10:33:03.942315+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:03.942315+0000","last_undegraded":"2024-09-18T10:33:03.942315+0000","last_fullsized":"2024-09-18T10:33:03.942315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:04.994379+0000","last_change":"2024-09-18T10:32:28.167569+0000","last_active":"2024-09-18T10:33:04.994379+0000","last_peered":"2024-09-18T10:33:04.994379+0000","last_clean":"2024-09-18T10:33:04.994379+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:04.994379+0000","last_undegraded":"2024-09-18T10:33:04.994379+0000","last_fullsized":"2024-09-18T10:33:04.994379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:28.167496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:28.167496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:42.920405+0000","scrub_duration":0.001229918,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936131+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:33:03.936131+0000","last_peered":"2024-09-18T10:33:03.936131+0000","last_clean":"2024-09-18T10:33:03.936131+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:03.936131+0000","last_undegraded":"2024-09-18T10:33:03.936131+0000","last_fullsized":"2024-09-18T10:33:03.936131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:35.877334+0000","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303160,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068680,"statfs":{"total":96636764160,"available":96326328320,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.62},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.87}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.91200000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.89100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.753},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82099999999999995}]}]},{"osd":14,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.437},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.78500000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55600000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.72799999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77100000000000002}]}]},{"osd":13,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1634304,"data_stored":1224095,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79500000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69799999999999995}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.90700000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.86499999999999999}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.88600000000000001}]}]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.81100000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":0.76500000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69899999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.82399999999999995}]}]},{"osd":1,"up_from":21,"seq":90194313246,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.376}]},{"osd":5,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.748},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.45700000000000002}]}]},{"osd":4,"up_from":21,"seq":90194313246,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":2.6240000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":2.028},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":2.7450000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":2.698},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":2.0819999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":2.774}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.998}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.966}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":2.665}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":2.1099999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.5},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67200000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.748},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85999999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70599999999999996}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84199999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.96399999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.94399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.749},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.80400000000000005}]}]},{"osd":5,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66300000000000003}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.72799999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50800000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71799999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.78800000000000003}]}]},{"osd":6,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.64300000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58799999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]},{"osd":14,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81000000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.97699999999999998}]}]},{"osd":7,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.27400000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.433}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56200000000000006}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58399999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55100000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69999999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.628},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]}]},{"osd":8,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.625}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.73199999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.871}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82699999999999996}]}]},{"osd":9,"up_from":97,"seq":416611827723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299536,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072304,"statfs":{"total":96636764160,"available":96330039296,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":10,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.92800000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.88800000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.871}]}]},{"osd":11,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.748}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59799999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68799999999999994}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55100000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63900000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88600000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1622016,"data_stored":1214577,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.65000000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.73999999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.67800000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.68999999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:08.939 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-18T10:33:08.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-18T10:33:09.233 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-18T10:33:09.245 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-09-18T10:33:09.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:33:09.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:09.519 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":139,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:33:05.943462+0000","last_up_change":"2024-09-18T10:32:21.600101+0000","last_in_change":"2024-09-18T10:32:32.732978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":73,"up_from":97,"up_thru":138,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":44795},{"type":"v1","addr":"172.21.15.71:6810","nonce":44795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":44795},{"type":"v1","addr":"172.21.15.71:6814","nonce":44795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":44795},{"type":"v1","addr":"172.21.15.71:6822","nonce":44795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":44795},{"type":"v1","addr":"172.21.15.71:6818","nonce":44795}]},"public_addr":"172.21.15.71:6810/44795","cluster_addr":"172.21.15.71:6814/44795","heartbeat_back_addr":"172.21.15.71:6822/44795","heartbeat_front_addr":"172.21.15.71:6818/44795","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:25.978869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.001886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:13.053079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.155220+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.605168+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:06.953638+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:04.067522+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:03.953892+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.963660+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:23.553273+0000","dead_epoch":76},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:27.998906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:00.977419+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:26.791355+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:14.175367+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:20.147292+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:17.297466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":56,"length":1},{"begin":60,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:33:09.532 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-18T10:33:09.532 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:09.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:09.811 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:09.820 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-18T10:33:08.637973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4825408,"kb_used_data":25500,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505124032,"statfs":{"total":1546188226560,"available":1541247008768,"internally_reserved":0,"allocated":26112000,"data_stored":20576484,"data_compressed":5554709,"data_compressed_allocated":7639040,"data_compressed_original":16171008,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711211"},"pg_stats":[{"pgid":"1.0","version":"26'112","reported_seq":264,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936133+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:33:03.936133+0000","last_peered":"2024-09-18T10:33:03.936133+0000","last_clean":"2024-09-18T10:33:03.936133+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:03.936133+0000","last_undegraded":"2024-09-18T10:33:03.936133+0000","last_fullsized":"2024-09-18T10:33:03.936133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:29.772412+0000","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":131,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777495+0000","last_change":"2024-09-18T10:32:35.935490+0000","last_active":"2024-09-18T10:33:05.777495+0000","last_peered":"2024-09-18T10:33:05.777495+0000","last_clean":"2024-09-18T10:33:05.777495+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:05.777495+0000","last_undegraded":"2024-09-18T10:33:05.777495+0000","last_fullsized":"2024-09-18T10:33:05.777495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-18T10:32:35.935394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:35.935394+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:50.624982+0000","scrub_duration":0.0020068159999999998,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.096359+0000","last_change":"2024-09-18T10:33:06.096359+0000","last_active":"2024-09-18T10:33:06.096359+0000","last_peered":"2024-09-18T10:33:06.096359+0000","last_clean":"2024-09-18T10:33:06.096359+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:06.096359+0000","last_undegraded":"2024-09-18T10:33:06.096359+0000","last_fullsized":"2024-09-18T10:33:06.096359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.667737+0000","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777489+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:33:05.777489+0000","last_peered":"2024-09-18T10:33:05.777489+0000","last_clean":"2024-09-18T10:33:05.777489+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:05.777489+0000","last_undegraded":"2024-09-18T10:33:05.777489+0000","last_fullsized":"2024-09-18T10:33:05.777489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":134,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936116+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:33:03.936116+0000","last_peered":"2024-09-18T10:33:03.936116+0000","last_clean":"2024-09-18T10:33:03.936116+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:03.936116+0000","last_undegraded":"2024-09-18T10:33:03.936116+0000","last_fullsized":"2024-09-18T10:33:03.936116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:12.407310+0000","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":131,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936105+0000","last_change":"2024-09-18T10:32:15.506544+0000","last_active":"2024-09-18T10:33:03.936105+0000","last_peered":"2024-09-18T10:33:03.936105+0000","last_clean":"2024-09-18T10:33:03.936105+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:03.936105+0000","last_undegraded":"2024-09-18T10:33:03.936105+0000","last_fullsized":"2024-09-18T10:33:03.936105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.506457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:26.446339+0000","scrub_duration":0.0014457090000000001,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.942315+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:33:03.942315+0000","last_peered":"2024-09-18T10:33:03.942315+0000","last_clean":"2024-09-18T10:33:03.942315+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:03.942315+0000","last_undegraded":"2024-09-18T10:33:03.942315+0000","last_fullsized":"2024-09-18T10:33:03.942315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:04.994379+0000","last_change":"2024-09-18T10:32:28.167569+0000","last_active":"2024-09-18T10:33:04.994379+0000","last_peered":"2024-09-18T10:33:04.994379+0000","last_clean":"2024-09-18T10:33:04.994379+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:04.994379+0000","last_undegraded":"2024-09-18T10:33:04.994379+0000","last_fullsized":"2024-09-18T10:33:04.994379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:28.167496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:28.167496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:42.920405+0000","scrub_duration":0.001229918,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936131+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:33:03.936131+0000","last_peered":"2024-09-18T10:33:03.936131+0000","last_clean":"2024-09-18T10:33:03.936131+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:03.936131+0000","last_undegraded":"2024-09-18T10:33:03.936131+0000","last_fullsized":"2024-09-18T10:33:03.936131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:35.877334+0000","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303160,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068680,"statfs":{"total":96636764160,"available":96326328320,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.62},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.87}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.91200000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.89100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.753},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82099999999999995}]}]},{"osd":14,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.437},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.78500000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55600000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.72799999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77100000000000002}]}]},{"osd":13,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1634304,"data_stored":1224095,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79500000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69799999999999995}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.90700000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.86499999999999999}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.88600000000000001}]}]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.81100000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":0.76500000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69899999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.82399999999999995}]}]},{"osd":1,"up_from":21,"seq":90194313246,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.376}]},{"osd":5,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.748},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.45700000000000002}]}]},{"osd":4,"up_from":21,"seq":90194313246,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":2.6240000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":2.028},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":2.7450000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":2.698},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":2.0819999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":2.774}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.998}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.966}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":2.665}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":2.1099999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.5},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67200000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.748},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85999999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70599999999999996}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84199999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.96399999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.94399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.749},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.80400000000000005}]}]},{"osd":5,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66300000000000003}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.72799999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50800000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71799999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.78800000000000003}]}]},{"osd":6,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.64300000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58799999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]},{"osd":14,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81000000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.97699999999999998}]}]},{"osd":7,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.27400000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.433}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56200000000000006}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58399999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55100000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69999999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.628},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]}]},{"osd":8,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.625}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.73199999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.871}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82699999999999996}]}]},{"osd":9,"up_from":97,"seq":416611827723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299536,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072304,"statfs":{"total":96636764160,"available":96330039296,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":10,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.92800000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.88800000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.871}]}]},{"osd":11,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.748}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59799999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68799999999999994}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55100000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63900000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88600000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1622016,"data_stored":1214577,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.65000000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.73999999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.67800000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.68999999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:09.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:10.103 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:10.104 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:10.117 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-18T10:33:08.637973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4825408,"kb_used_data":25500,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505124032,"statfs":{"total":1546188226560,"available":1541247008768,"internally_reserved":0,"allocated":26112000,"data_stored":20576484,"data_compressed":5554709,"data_compressed_allocated":7639040,"data_compressed_original":16171008,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711211"},"pg_stats":[{"pgid":"1.0","version":"26'112","reported_seq":264,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936133+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:33:03.936133+0000","last_peered":"2024-09-18T10:33:03.936133+0000","last_clean":"2024-09-18T10:33:03.936133+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:03.936133+0000","last_undegraded":"2024-09-18T10:33:03.936133+0000","last_fullsized":"2024-09-18T10:33:03.936133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:29.772412+0000","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":131,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777495+0000","last_change":"2024-09-18T10:32:35.935490+0000","last_active":"2024-09-18T10:33:05.777495+0000","last_peered":"2024-09-18T10:33:05.777495+0000","last_clean":"2024-09-18T10:33:05.777495+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:05.777495+0000","last_undegraded":"2024-09-18T10:33:05.777495+0000","last_fullsized":"2024-09-18T10:33:05.777495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-18T10:32:35.935394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:35.935394+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:50.624982+0000","scrub_duration":0.0020068159999999998,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.096359+0000","last_change":"2024-09-18T10:33:06.096359+0000","last_active":"2024-09-18T10:33:06.096359+0000","last_peered":"2024-09-18T10:33:06.096359+0000","last_clean":"2024-09-18T10:33:06.096359+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:06.096359+0000","last_undegraded":"2024-09-18T10:33:06.096359+0000","last_fullsized":"2024-09-18T10:33:06.096359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.667737+0000","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777489+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:33:05.777489+0000","last_peered":"2024-09-18T10:33:05.777489+0000","last_clean":"2024-09-18T10:33:05.777489+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:05.777489+0000","last_undegraded":"2024-09-18T10:33:05.777489+0000","last_fullsized":"2024-09-18T10:33:05.777489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":134,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936116+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:33:03.936116+0000","last_peered":"2024-09-18T10:33:03.936116+0000","last_clean":"2024-09-18T10:33:03.936116+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:03.936116+0000","last_undegraded":"2024-09-18T10:33:03.936116+0000","last_fullsized":"2024-09-18T10:33:03.936116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:12.407310+0000","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":131,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936105+0000","last_change":"2024-09-18T10:32:15.506544+0000","last_active":"2024-09-18T10:33:03.936105+0000","last_peered":"2024-09-18T10:33:03.936105+0000","last_clean":"2024-09-18T10:33:03.936105+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:03.936105+0000","last_undegraded":"2024-09-18T10:33:03.936105+0000","last_fullsized":"2024-09-18T10:33:03.936105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.506457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:26.446339+0000","scrub_duration":0.0014457090000000001,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.942315+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:33:03.942315+0000","last_peered":"2024-09-18T10:33:03.942315+0000","last_clean":"2024-09-18T10:33:03.942315+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:03.942315+0000","last_undegraded":"2024-09-18T10:33:03.942315+0000","last_fullsized":"2024-09-18T10:33:03.942315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:04.994379+0000","last_change":"2024-09-18T10:32:28.167569+0000","last_active":"2024-09-18T10:33:04.994379+0000","last_peered":"2024-09-18T10:33:04.994379+0000","last_clean":"2024-09-18T10:33:04.994379+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:04.994379+0000","last_undegraded":"2024-09-18T10:33:04.994379+0000","last_fullsized":"2024-09-18T10:33:04.994379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:28.167496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:28.167496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:42.920405+0000","scrub_duration":0.001229918,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936131+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:33:03.936131+0000","last_peered":"2024-09-18T10:33:03.936131+0000","last_clean":"2024-09-18T10:33:03.936131+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:03.936131+0000","last_undegraded":"2024-09-18T10:33:03.936131+0000","last_fullsized":"2024-09-18T10:33:03.936131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:35.877334+0000","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303160,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068680,"statfs":{"total":96636764160,"available":96326328320,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.62},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.87}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.91200000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.89100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.753},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82099999999999995}]}]},{"osd":14,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.437},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.78500000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55600000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.72799999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77100000000000002}]}]},{"osd":13,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1634304,"data_stored":1224095,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79500000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69799999999999995}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.90700000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.86499999999999999}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.88600000000000001}]}]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.81100000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":0.76500000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69899999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.82399999999999995}]}]},{"osd":1,"up_from":21,"seq":90194313246,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.376}]},{"osd":5,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.748},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.45700000000000002}]}]},{"osd":4,"up_from":21,"seq":90194313246,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":2.6240000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":2.028},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":2.7450000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":2.698},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":2.0819999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":2.774}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.998}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.966}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":2.665}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":2.1099999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.5},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67200000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.748},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85999999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70599999999999996}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84199999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.96399999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.94399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.749},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.80400000000000005}]}]},{"osd":5,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66300000000000003}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.72799999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50800000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71799999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.78800000000000003}]}]},{"osd":6,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.64300000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58799999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]},{"osd":14,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81000000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.97699999999999998}]}]},{"osd":7,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.27400000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.433}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56200000000000006}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58399999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55100000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69999999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.628},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]}]},{"osd":8,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.625}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.73199999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.871}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82699999999999996}]}]},{"osd":9,"up_from":97,"seq":416611827723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299536,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072304,"statfs":{"total":96636764160,"available":96330039296,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":10,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.92800000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.88800000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.871}]}]},{"osd":11,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.748}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59799999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68799999999999994}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55100000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63900000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88600000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1622016,"data_stored":1214577,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.65000000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.73999999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.67800000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.68999999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:10.121 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-18T10:33:10.122 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:10.400 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:10.411 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-18T10:33:08.637973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4825408,"kb_used_data":25500,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505124032,"statfs":{"total":1546188226560,"available":1541247008768,"internally_reserved":0,"allocated":26112000,"data_stored":20576484,"data_compressed":5554709,"data_compressed_allocated":7639040,"data_compressed_original":16171008,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.711211"},"pg_stats":[{"pgid":"1.0","version":"26'112","reported_seq":264,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936133+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:33:03.936133+0000","last_peered":"2024-09-18T10:33:03.936133+0000","last_clean":"2024-09-18T10:33:03.936133+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:03.936133+0000","last_undegraded":"2024-09-18T10:33:03.936133+0000","last_fullsized":"2024-09-18T10:33:03.936133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:29.772412+0000","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":131,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777495+0000","last_change":"2024-09-18T10:32:35.935490+0000","last_active":"2024-09-18T10:33:05.777495+0000","last_peered":"2024-09-18T10:33:05.777495+0000","last_clean":"2024-09-18T10:33:05.777495+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:05.777495+0000","last_undegraded":"2024-09-18T10:33:05.777495+0000","last_fullsized":"2024-09-18T10:33:05.777495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-18T10:32:35.935394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:35.935394+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:50.624982+0000","scrub_duration":0.0020068159999999998,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.096359+0000","last_change":"2024-09-18T10:33:06.096359+0000","last_active":"2024-09-18T10:33:06.096359+0000","last_peered":"2024-09-18T10:33:06.096359+0000","last_clean":"2024-09-18T10:33:06.096359+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:06.096359+0000","last_undegraded":"2024-09-18T10:33:06.096359+0000","last_fullsized":"2024-09-18T10:33:06.096359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:19.667737+0000","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777489+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:33:05.777489+0000","last_peered":"2024-09-18T10:33:05.777489+0000","last_clean":"2024-09-18T10:33:05.777489+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:05.777489+0000","last_undegraded":"2024-09-18T10:33:05.777489+0000","last_fullsized":"2024-09-18T10:33:05.777489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":134,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936116+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:33:03.936116+0000","last_peered":"2024-09-18T10:33:03.936116+0000","last_clean":"2024-09-18T10:33:03.936116+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:03.936116+0000","last_undegraded":"2024-09-18T10:33:03.936116+0000","last_fullsized":"2024-09-18T10:33:03.936116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:12.407310+0000","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":131,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936105+0000","last_change":"2024-09-18T10:32:15.506544+0000","last_active":"2024-09-18T10:33:03.936105+0000","last_peered":"2024-09-18T10:33:03.936105+0000","last_clean":"2024-09-18T10:33:03.936105+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:03.936105+0000","last_undegraded":"2024-09-18T10:33:03.936105+0000","last_fullsized":"2024-09-18T10:33:03.936105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.506457+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.506457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:26.446339+0000","scrub_duration":0.0014457090000000001,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.942315+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:33:03.942315+0000","last_peered":"2024-09-18T10:33:03.942315+0000","last_clean":"2024-09-18T10:33:03.942315+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:03.942315+0000","last_undegraded":"2024-09-18T10:33:03.942315+0000","last_fullsized":"2024-09-18T10:33:03.942315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:04.994379+0000","last_change":"2024-09-18T10:32:28.167569+0000","last_active":"2024-09-18T10:33:04.994379+0000","last_peered":"2024-09-18T10:33:04.994379+0000","last_clean":"2024-09-18T10:33:04.994379+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:04.994379+0000","last_undegraded":"2024-09-18T10:33:04.994379+0000","last_fullsized":"2024-09-18T10:33:04.994379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:28.167496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:28.167496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:42.920405+0000","scrub_duration":0.001229918,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-18T10:33:03.936131+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:33:03.936131+0000","last_peered":"2024-09-18T10:33:03.936131+0000","last_clean":"2024-09-18T10:33:03.936131+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:03.936131+0000","last_undegraded":"2024-09-18T10:33:03.936131+0000","last_fullsized":"2024-09-18T10:33:03.936131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:35.877334+0000","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303160,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068680,"statfs":{"total":96636764160,"available":96326328320,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.62},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.87}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.70399999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.91200000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.89100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.753},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82099999999999995}]}]},{"osd":14,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.437},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.78500000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55600000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.64900000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.72799999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77100000000000002}]}]},{"osd":13,"up_from":22,"seq":94489280541,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1634304,"data_stored":1224095,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40500000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.49199999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.624}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79500000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.52800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.69799999999999995}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68400000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.90700000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.86499999999999999}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.88600000000000001}]}]},{"osd":0,"up_from":21,"seq":90194313245,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51700000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.81100000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.58399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":0.76500000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.69899999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.82399999999999995}]}]},{"osd":1,"up_from":21,"seq":90194313246,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.0089999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.376}]},{"osd":5,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.35799999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.748},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57299999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42999999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.45700000000000002}]}]},{"osd":4,"up_from":21,"seq":90194313246,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":2.6240000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.90900000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":2.028},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":2.7450000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":2.5649999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":2.698},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.76000000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":2.0819999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":2.774}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.998}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.966}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":2.665}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":2.1099999999999999}]}]},{"osd":2,"up_from":22,"seq":94489280541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.5},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67200000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.748},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.85999999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70599999999999996}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.84199999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68500000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.66000000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.96399999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.94399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.749},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.80400000000000005}]}]},{"osd":5,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.621},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66300000000000003}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.72799999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50800000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71799999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.78800000000000003}]}]},{"osd":6,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303168,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068672,"statfs":{"total":96636764160,"available":96326320128,"internally_reserved":0,"allocated":1683456,"data_stored":1753004,"data_compressed":357171,"data_compressed_allocated":507904,"data_compressed_original":1462272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42099999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52000000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":7,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.64300000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58799999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]},{"osd":14,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81000000000000005}]},{"osd":15,"last update":"Wed Sep 18 10:32:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.97699999999999998}]}]},{"osd":7,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1630208,"data_stored":1224076,"data_compressed":347246,"data_compressed_allocated":475136,"data_compressed_original":950272,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.27400000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.433}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51900000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56200000000000006}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58399999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55100000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.69999999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.628},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68500000000000005}]}]},{"osd":8,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.53600000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.61199999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57599999999999996}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.625}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.73199999999999998}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.871}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82699999999999996}]}]},{"osd":9,"up_from":97,"seq":416611827723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299536,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072304,"statfs":{"total":96636764160,"available":96330039296,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":10,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298936,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072904,"statfs":{"total":96636764160,"available":96330653696,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.92800000000000005}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.88800000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.63}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79200000000000004}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82399999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.871}]}]},{"osd":11,"up_from":22,"seq":94489280540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1617920,"data_stored":1214558,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.748}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59799999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68799999999999994}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55100000000000005}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63900000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.83199999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88600000000000001}]}]},{"osd":12,"up_from":22,"seq":94489280541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1622016,"data_stored":1214577,"data_compressed":344235,"data_compressed_allocated":471040,"data_compressed_original":942080,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.5}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.65000000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.73999999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.67800000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.68999999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.72899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:10.415 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-18T10:33:10.689 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:10.690 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":139,"fsid":"f10241a9-9f2d-4ca9-8e5f-6c8b84917f59","created":"2024-09-18T10:30:48.790325+0000","modified":"2024-09-18T10:33:05.943462+0000","last_up_change":"2024-09-18T10:32:21.600101+0000","last_in_change":"2024-09-18T10:32:32.732978+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T10:31:00.658279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-18T10:31:03.266294+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c9c90e0f-90b7-4324-b194-50466925bab4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33484},{"type":"v1","addr":"172.21.15.63:6801","nonce":33484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33484},{"type":"v1","addr":"172.21.15.63:6803","nonce":33484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33484},{"type":"v1","addr":"172.21.15.63:6807","nonce":33484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":33484},{"type":"v1","addr":"172.21.15.63:6805","nonce":33484}]},"public_addr":"172.21.15.63:6801/33484","cluster_addr":"172.21.15.63:6803/33484","heartbeat_back_addr":"172.21.15.63:6807/33484","heartbeat_front_addr":"172.21.15.63:6805/33484","state":["exists","up"]},{"osd":1,"uuid":"364707f8-7c53-4434-8eb4-bed8f4fd131d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":32741},{"type":"v1","addr":"172.21.15.71:6801","nonce":32741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":32741},{"type":"v1","addr":"172.21.15.71:6803","nonce":32741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":32741},{"type":"v1","addr":"172.21.15.71:6807","nonce":32741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":32741},{"type":"v1","addr":"172.21.15.71:6805","nonce":32741}]},"public_addr":"172.21.15.71:6801/32741","cluster_addr":"172.21.15.71:6803/32741","heartbeat_back_addr":"172.21.15.71:6807/32741","heartbeat_front_addr":"172.21.15.71:6805/32741","state":["exists","up"]},{"osd":2,"uuid":"a1f8ec72-eb1a-4808-beba-7a6e6e840e5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":33036},{"type":"v1","addr":"172.21.15.100:6810","nonce":33036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":33036},{"type":"v1","addr":"172.21.15.100:6816","nonce":33036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":33036},{"type":"v1","addr":"172.21.15.100:6828","nonce":33036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":33036},{"type":"v1","addr":"172.21.15.100:6822","nonce":33036}]},"public_addr":"172.21.15.100:6810/33036","cluster_addr":"172.21.15.100:6816/33036","heartbeat_back_addr":"172.21.15.100:6828/33036","heartbeat_front_addr":"172.21.15.100:6822/33036","state":["exists","up"]},{"osd":3,"uuid":"7528ada4-39f9-44a0-b312-d9774c1c38b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6811","nonce":33050},{"type":"v1","addr":"172.21.15.160:6813","nonce":33050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":33050},{"type":"v1","addr":"172.21.15.160:6816","nonce":33050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":33050},{"type":"v1","addr":"172.21.15.160:6824","nonce":33050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":33050},{"type":"v1","addr":"172.21.15.160:6820","nonce":33050}]},"public_addr":"172.21.15.160:6813/33050","cluster_addr":"172.21.15.160:6816/33050","heartbeat_back_addr":"172.21.15.160:6824/33050","heartbeat_front_addr":"172.21.15.160:6820/33050","state":["exists","up"]},{"osd":4,"uuid":"7e30062e-3d74-4374-abe1-708614474f78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":33485},{"type":"v1","addr":"172.21.15.63:6809","nonce":33485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":33485},{"type":"v1","addr":"172.21.15.63:6811","nonce":33485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33485},{"type":"v1","addr":"172.21.15.63:6815","nonce":33485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33485},{"type":"v1","addr":"172.21.15.63:6813","nonce":33485}]},"public_addr":"172.21.15.63:6809/33485","cluster_addr":"172.21.15.63:6811/33485","heartbeat_back_addr":"172.21.15.63:6815/33485","heartbeat_front_addr":"172.21.15.63:6813/33485","state":["exists","up"]},{"osd":5,"uuid":"cfbff4f8-6118-4080-8c53-a9191a6e2e2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":32742},{"type":"v1","addr":"172.21.15.71:6811","nonce":32742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6813","nonce":32742},{"type":"v1","addr":"172.21.15.71:6815","nonce":32742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6821","nonce":32742},{"type":"v1","addr":"172.21.15.71:6823","nonce":32742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":32742},{"type":"v1","addr":"172.21.15.71:6819","nonce":32742}]},"public_addr":"172.21.15.71:6811/32742","cluster_addr":"172.21.15.71:6815/32742","heartbeat_back_addr":"172.21.15.71:6823/32742","heartbeat_front_addr":"172.21.15.71:6819/32742","state":["exists","up"]},{"osd":6,"uuid":"2dc036cf-74e5-4e91-9f75-9f122e112a49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":33037},{"type":"v1","addr":"172.21.15.100:6801","nonce":33037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":33037},{"type":"v1","addr":"172.21.15.100:6803","nonce":33037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":33037},{"type":"v1","addr":"172.21.15.100:6807","nonce":33037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":33037},{"type":"v1","addr":"172.21.15.100:6805","nonce":33037}]},"public_addr":"172.21.15.100:6801/33037","cluster_addr":"172.21.15.100:6803/33037","heartbeat_back_addr":"172.21.15.100:6807/33037","heartbeat_front_addr":"172.21.15.100:6805/33037","state":["exists","up"]},{"osd":7,"uuid":"72893ca2-e288-4271-9fe0-c3df5c26d0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":33051},{"type":"v1","addr":"172.21.15.160:6803","nonce":33051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":33051},{"type":"v1","addr":"172.21.15.160:6805","nonce":33051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":33051},{"type":"v1","addr":"172.21.15.160:6809","nonce":33051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":33051},{"type":"v1","addr":"172.21.15.160:6807","nonce":33051}]},"public_addr":"172.21.15.160:6803/33051","cluster_addr":"172.21.15.160:6805/33051","heartbeat_back_addr":"172.21.15.160:6809/33051","heartbeat_front_addr":"172.21.15.160:6807/33051","state":["exists","up"]},{"osd":8,"uuid":"c5a0c4b5-4450-43bb-9571-509d1baa2db6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33488},{"type":"v1","addr":"172.21.15.63:6817","nonce":33488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33488},{"type":"v1","addr":"172.21.15.63:6819","nonce":33488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33488},{"type":"v1","addr":"172.21.15.63:6823","nonce":33488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33488},{"type":"v1","addr":"172.21.15.63:6821","nonce":33488}]},"public_addr":"172.21.15.63:6817/33488","cluster_addr":"172.21.15.63:6819/33488","heartbeat_back_addr":"172.21.15.63:6823/33488","heartbeat_front_addr":"172.21.15.63:6821/33488","state":["exists","up"]},{"osd":9,"uuid":"bdca945d-8cfe-4bea-a7a6-10116f45f750","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":73,"up_from":97,"up_thru":138,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":44795},{"type":"v1","addr":"172.21.15.71:6810","nonce":44795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":44795},{"type":"v1","addr":"172.21.15.71:6814","nonce":44795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":44795},{"type":"v1","addr":"172.21.15.71:6822","nonce":44795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":44795},{"type":"v1","addr":"172.21.15.71:6818","nonce":44795}]},"public_addr":"172.21.15.71:6810/44795","cluster_addr":"172.21.15.71:6814/44795","heartbeat_back_addr":"172.21.15.71:6822/44795","heartbeat_front_addr":"172.21.15.71:6818/44795","state":["exists","up"]},{"osd":10,"uuid":"2d48159a-96d0-4e9b-9ae3-1102ef4aa1bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":33038},{"type":"v1","addr":"172.21.15.100:6814","nonce":33038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":33038},{"type":"v1","addr":"172.21.15.100:6820","nonce":33038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6829","nonce":33038},{"type":"v1","addr":"172.21.15.100:6831","nonce":33038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":33038},{"type":"v1","addr":"172.21.15.100:6826","nonce":33038}]},"public_addr":"172.21.15.100:6814/33038","cluster_addr":"172.21.15.100:6820/33038","heartbeat_back_addr":"172.21.15.100:6831/33038","heartbeat_front_addr":"172.21.15.100:6826/33038","state":["exists","up"]},{"osd":11,"uuid":"74271b10-6952-4938-9916-e89bc18a872f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":33052},{"type":"v1","addr":"172.21.15.160:6827","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":33052},{"type":"v1","addr":"172.21.15.160:6829","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":33052},{"type":"v1","addr":"172.21.15.160:6833","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":33052},{"type":"v1","addr":"172.21.15.160:6831","nonce":33052}]},"public_addr":"172.21.15.160:6827/33052","cluster_addr":"172.21.15.160:6829/33052","heartbeat_back_addr":"172.21.15.160:6833/33052","heartbeat_front_addr":"172.21.15.160:6831/33052","state":["exists","up"]},{"osd":12,"uuid":"9a3a5069-5cd1-450a-813b-ddd96237db5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33486},{"type":"v1","addr":"172.21.15.63:6825","nonce":33486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":33486},{"type":"v1","addr":"172.21.15.63:6827","nonce":33486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":33486},{"type":"v1","addr":"172.21.15.63:6831","nonce":33486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":33486},{"type":"v1","addr":"172.21.15.63:6829","nonce":33486}]},"public_addr":"172.21.15.63:6825/33486","cluster_addr":"172.21.15.63:6827/33486","heartbeat_back_addr":"172.21.15.63:6831/33486","heartbeat_front_addr":"172.21.15.63:6829/33486","state":["exists","up"]},{"osd":13,"uuid":"47a76a68-b71d-4012-b2f7-3e40e8583a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":32744},{"type":"v1","addr":"172.21.15.71:6825","nonce":32744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":32744},{"type":"v1","addr":"172.21.15.71:6827","nonce":32744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":32744},{"type":"v1","addr":"172.21.15.71:6831","nonce":32744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":32744},{"type":"v1","addr":"172.21.15.71:6829","nonce":32744}]},"public_addr":"172.21.15.71:6825/32744","cluster_addr":"172.21.15.71:6827/32744","heartbeat_back_addr":"172.21.15.71:6831/32744","heartbeat_front_addr":"172.21.15.71:6829/32744","state":["exists","up"]},{"osd":14,"uuid":"5297107d-2ab9-4107-8461-0aa59c98d685","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":33039},{"type":"v1","addr":"172.21.15.100:6812","nonce":33039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":33039},{"type":"v1","addr":"172.21.15.100:6818","nonce":33039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6827","nonce":33039},{"type":"v1","addr":"172.21.15.100:6830","nonce":33039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":33039},{"type":"v1","addr":"172.21.15.100:6824","nonce":33039}]},"public_addr":"172.21.15.100:6812/33039","cluster_addr":"172.21.15.100:6818/33039","heartbeat_back_addr":"172.21.15.100:6830/33039","heartbeat_front_addr":"172.21.15.100:6824/33039","state":["exists","up"]},{"osd":15,"uuid":"1bcc1d74-88c8-4dc5-8262-ead5b4a20377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":33053},{"type":"v1","addr":"172.21.15.160:6812","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6815","nonce":33053},{"type":"v1","addr":"172.21.15.160:6817","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6823","nonce":33053},{"type":"v1","addr":"172.21.15.160:6825","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6819","nonce":33053},{"type":"v1","addr":"172.21.15.160:6821","nonce":33053}]},"public_addr":"172.21.15.160:6812/33053","cluster_addr":"172.21.15.160:6817/33053","heartbeat_back_addr":"172.21.15.160:6825/33053","heartbeat_front_addr":"172.21.15.160:6821/33053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:25.978869+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.001886+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:13.053079+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.155220+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:11.605168+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:06.953638+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:04.067522+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:03.953892+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:08.963660+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:23.553273+0000","dead_epoch":76},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:27.998906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:00.977419+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:26.791355+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:14.175367+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:20.147292+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T10:32:17.297466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":56,"length":1},{"begin":60,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T10:33:11.702 INFO:tasks.ceph:Scrubbing osd.0 2024-09-18T10:33:11.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:11.839 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:11.839 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:11.839 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:11.849 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-18T10:33:12.124 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-18T10:33:12.137 INFO:tasks.ceph:Scrubbing osd.4 2024-09-18T10:33:12.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:12.257 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:12.257 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:12.257 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:12.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-18T10:33:12.541 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2024-09-18T10:33:12.553 INFO:tasks.ceph:Scrubbing osd.8 2024-09-18T10:33:12.553 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:12.675 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:12.676 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:12.676 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:12.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-09-18T10:33:12.963 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 8 to deep-scrub 2024-09-18T10:33:12.975 INFO:tasks.ceph:Scrubbing osd.12 2024-09-18T10:33:12.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:13.098 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:13.098 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:13.099 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:13.109 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2024-09-18T10:33:13.382 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 12 to deep-scrub 2024-09-18T10:33:13.394 INFO:tasks.ceph:Scrubbing osd.1 2024-09-18T10:33:13.395 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:13.516 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:13.516 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:13.517 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:13.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-18T10:33:13.800 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-18T10:33:13.813 INFO:tasks.ceph:Scrubbing osd.5 2024-09-18T10:33:13.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:13.935 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:13.935 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:13.935 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:13.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-18T10:33:14.217 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2024-09-18T10:33:14.230 INFO:tasks.ceph:Scrubbing osd.9 2024-09-18T10:33:14.230 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:14.352 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:14.352 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:14.352 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:14.363 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-09-18T10:33:14.637 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 9 to deep-scrub 2024-09-18T10:33:14.650 INFO:tasks.ceph:Scrubbing osd.13 2024-09-18T10:33:14.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:14.773 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:14.773 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:14.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2024-09-18T10:33:15.057 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 13 to deep-scrub 2024-09-18T10:33:15.069 INFO:tasks.ceph:Scrubbing osd.2 2024-09-18T10:33:15.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:15.191 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:15.192 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:15.192 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:15.202 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-18T10:33:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-18T10:33:15.488 INFO:tasks.ceph:Scrubbing osd.6 2024-09-18T10:33:15.489 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:15.611 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:15.612 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:15.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-18T10:33:15.895 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2024-09-18T10:33:15.908 INFO:tasks.ceph:Scrubbing osd.10 2024-09-18T10:33:15.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:16.030 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:16.030 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:16.031 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:16.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-09-18T10:33:16.314 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 10 to deep-scrub 2024-09-18T10:33:16.326 INFO:tasks.ceph:Scrubbing osd.14 2024-09-18T10:33:16.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:16.448 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:16.448 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:16.448 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:16.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2024-09-18T10:33:16.731 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 14 to deep-scrub 2024-09-18T10:33:16.743 INFO:tasks.ceph:Scrubbing osd.3 2024-09-18T10:33:16.743 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:16.866 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:16.866 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:16.866 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:16.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-18T10:33:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2024-09-18T10:33:17.164 INFO:tasks.ceph:Scrubbing osd.7 2024-09-18T10:33:17.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:17.286 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:17.287 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:17.287 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:17.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-18T10:33:17.570 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2024-09-18T10:33:17.583 INFO:tasks.ceph:Scrubbing osd.11 2024-09-18T10:33:17.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:17.706 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:17.706 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:17.706 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:17.716 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-09-18T10:33:17.991 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 11 to deep-scrub 2024-09-18T10:33:18.005 INFO:tasks.ceph:Scrubbing osd.15 2024-09-18T10:33:18.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2024-09-18T10:33:18.127 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-18T10:33:18.128 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-18T10:33:18.128 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-18T10:33:18.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2024-09-18T10:33:18.410 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 15 to deep-scrub 2024-09-18T10:33:18.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:18.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:18.701 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:18.712 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-18T10:33:18.640142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4825744,"kb_used_data":25776,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505123696,"statfs":{"total":1546188226560,"available":1541246664704,"internally_reserved":0,"allocated":26394624,"data_stored":20795398,"data_compressed":5623962,"data_compressed_allocated":7733248,"data_compressed_original":16359424,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002573"},"pg_stats":[{"pgid":"1.0","version":"26'112","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.097382+0000","last_change":"2024-09-18T10:32:24.325254+0000","last_active":"2024-09-18T10:33:06.097382+0000","last_peered":"2024-09-18T10:33:06.097382+0000","last_clean":"2024-09-18T10:33:06.097382+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:06.097382+0000","last_undegraded":"2024-09-18T10:33:06.097382+0000","last_fullsized":"2024-09-18T10:33:06.097382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'112","last_scrub_stamp":"2024-09-18T10:32:24.325171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:01.041556+0000","last_clean_scrub_stamp":"2024-09-18T10:32:24.325171+0000","objects_scrubbed":2,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for deep scrub","scrub_duration":0.002179252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":131,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777495+0000","last_change":"2024-09-18T10:32:35.935490+0000","last_active":"2024-09-18T10:33:05.777495+0000","last_peered":"2024-09-18T10:33:05.777495+0000","last_clean":"2024-09-18T10:33:05.777495+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:05.777495+0000","last_undegraded":"2024-09-18T10:33:05.777495+0000","last_fullsized":"2024-09-18T10:33:05.777495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-09-18T10:32:35.935394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:35.935394+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:50.624982+0000","scrub_duration":0.0020068159999999998,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":81,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.096919+0000","last_change":"2024-09-18T10:33:06.096359+0000","last_active":"2024-09-18T10:33:06.096919+0000","last_peered":"2024-09-18T10:33:06.096919+0000","last_clean":"2024-09-18T10:33:06.096919+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:06.096919+0000","last_undegraded":"2024-09-18T10:33:06.096919+0000","last_fullsized":"2024-09-18T10:33:06.096919+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:12.279296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:12.279296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for deep scrub","scrub_duration":0.0011784040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777489+0000","last_change":"2024-09-18T10:32:15.925830+0000","last_active":"2024-09-18T10:33:05.777489+0000","last_peered":"2024-09-18T10:33:05.777489+0000","last_clean":"2024-09-18T10:33:05.777489+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:05.777489+0000","last_undegraded":"2024-09-18T10:33:05.777489+0000","last_fullsized":"2024-09-18T10:33:05.777489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:32:15.925761+0000","last_clean_scrub_stamp":"2024-09-18T10:32:15.925761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:22.393578+0000","scrub_duration":0.001394555,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":136,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.095135+0000","last_change":"2024-09-18T10:32:11.211272+0000","last_active":"2024-09-18T10:33:06.095135+0000","last_peered":"2024-09-18T10:33:06.095135+0000","last_clean":"2024-09-18T10:33:06.095135+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:06.095135+0000","last_undegraded":"2024-09-18T10:33:06.095135+0000","last_fullsized":"2024-09-18T10:33:06.095135+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-09-18T10:32:11.211201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:11.211201+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for deep scrub","scrub_duration":0.0016403800000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:13.383897+0000","last_change":"2024-09-18T10:33:13.383863+0000","last_active":"2024-09-18T10:33:13.383897+0000","last_peered":"2024-09-18T10:33:13.383897+0000","last_clean":"2024-09-18T10:33:13.383897+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:13.383897+0000","last_undegraded":"2024-09-18T10:33:13.383897+0000","last_fullsized":"2024-09-18T10:33:13.383897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:13.383743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:13.383743+0000","last_clean_scrub_stamp":"2024-09-18T10:33:13.383743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:38.890401+0000","scrub_duration":0.0012564919999999999,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-18T10:33:05.777407+0000","last_change":"2024-09-18T10:32:14.339163+0000","last_active":"2024-09-18T10:33:05.777407+0000","last_peered":"2024-09-18T10:33:05.777407+0000","last_clean":"2024-09-18T10:33:05.777407+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:05.777407+0000","last_undegraded":"2024-09-18T10:33:05.777407+0000","last_fullsized":"2024-09-18T10:33:05.777407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:14.339076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:14.339076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:33.474927+0000","scrub_duration":0.0019273820000000001,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:15.603358+0000","last_change":"2024-09-18T10:33:15.603336+0000","last_active":"2024-09-18T10:33:15.603358+0000","last_peered":"2024-09-18T10:33:15.603358+0000","last_clean":"2024-09-18T10:33:15.603358+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:15.603358+0000","last_undegraded":"2024-09-18T10:33:15.603358+0000","last_fullsized":"2024-09-18T10:33:15.603358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:15.603271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:15.603271+0000","last_clean_scrub_stamp":"2024-09-18T10:33:15.603271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:17.594465+0000","scrub_duration":0.0015189100000000001,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-18T10:33:06.095162+0000","last_change":"2024-09-18T10:32:23.139864+0000","last_active":"2024-09-18T10:33:06.095162+0000","last_peered":"2024-09-18T10:33:06.095162+0000","last_clean":"2024-09-18T10:33:06.095162+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:06.095162+0000","last_undegraded":"2024-09-18T10:33:06.095162+0000","last_fullsized":"2024-09-18T10:33:06.095162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:32:23.139765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:31:04.163714+0000","last_clean_scrub_stamp":"2024-09-18T10:32:23.139765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for deep scrub","scrub_duration":0.001627224,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303176,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068664,"statfs":{"total":96636764160,"available":96326311936,"internally_reserved":0,"allocated":1695744,"data_stored":1762522,"data_compressed":360182,"data_compressed_allocated":512000,"data_compressed_original":1470464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.499},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47899999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38900000000000001}]},{"osd":4,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.57299999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.60099999999999998}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.63400000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.622},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.61399999999999999}]}]},{"osd":14,"up_from":22,"seq":94489280543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303132,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068708,"statfs":{"total":96636764160,"available":96326356992,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.39800000000000002}]},{"osd":1,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.47699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.51200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.87}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.73099999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":10,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51200000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.60299999999999998}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.85199999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.749},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.76100000000000001}]}]},{"osd":13,"up_from":22,"seq":94489280543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303132,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068708,"statfs":{"total":96636764160,"available":96326356992,"internally_reserved":0,"allocated":1646592,"data_stored":1233613,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.498},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.71699999999999997}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.83699999999999997}]},{"osd":8,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.621},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.79300000000000004}]},{"osd":11,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.82299999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.748}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.78000000000000003}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.88100000000000001}]}]},{"osd":0,"up_from":21,"seq":90194313247,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.503},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.441}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.32500000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":0.40699999999999997}]},{"osd":14,"last update":"Wed Sep 18 10:32:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.49099999999999999}]}]},{"osd":1,"up_from":21,"seq":90194313248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298964,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.41899999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92200000000000004,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85599999999999998,"5min":2.077,"15min":2.077},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88400000000000001,"5min":1.329,"15min":1.329},"last":0.442}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.497},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.48799999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.67500000000000004,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":1.99,"15min":1.99},"last":0.35299999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.748},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.64900000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60199999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.59999999999999998,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.313,"15min":0.313},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38300000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.84199999999999997,"5min":2.302,"15min":2.302},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.66000000000000003}]},{"osd":15,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.82799999999999996,"5min":1.256,"15min":1.256},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98899999999999999,"5min":2.371,"15min":2.371},"last":0.51500000000000001}]}]},{"osd":4,"up_from":21,"seq":90194313248,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303116,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068724,"statfs":{"total":96636764160,"available":96326373376,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.29399999999999998}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.432},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.48699999999999999}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.55000000000000004}]},{"osd":12,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.33100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.45200000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.58599999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":0.59599999999999997}]}]},{"osd":2,"up_from":22,"seq":94489280543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303128,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068712,"statfs":{"total":96636764160,"available":96326361088,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.30099999999999999}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.54100000000000004}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.495},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.41399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.441},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.48299999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.42899999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.59599999999999997}]}]},{"osd":3,"up_from":22,"seq":94489280543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303128,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068712,"statfs":{"total":96636764160,"available":96326361088,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63900000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.32700000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.71199999999999997,"5min":1.02,"15min":1.02},"last":0.57999999999999996}]},{"osd":4,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79400000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.628},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.502},"min":{"1min":0.30399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84699999999999998,"5min":0.876,"15min":0.876},"last":0.61199999999999999}]},{"osd":8,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85599999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60199999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1,"5min":1,"15min":1},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65700000000000003,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72399999999999998}]},{"osd":13,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81899999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76700000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.755}]}]},{"osd":5,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.499}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.57599999999999996}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.60699999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.54600000000000004}]},{"osd":13,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.62},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.45200000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71099999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.56299999999999994}]}]},{"osd":6,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303172,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068668,"statfs":{"total":96636764160,"available":96326316032,"internally_reserved":0,"allocated":1695744,"data_stored":1762522,"data_compressed":360182,"data_compressed_allocated":512000,"data_compressed_original":1470464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.371}]},{"osd":1,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.872,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.629}]},{"osd":3,"last update":"Wed Sep 18 10:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.496}]},{"osd":5,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72599999999999998,"5min":0.874,"15min":0.874},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89700000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81999999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41899999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.022,"5min":1.266,"15min":1.266},"last":0.60899999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.024},"last":0.54200000000000004}]},{"osd":13,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96599999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.67800000000000005}]},{"osd":14,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.83499999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.61599999999999999}]},{"osd":15,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97699999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0609999999999999,"5min":1.226,"15min":1.226},"last":0.69199999999999995}]}]},{"osd":7,"up_from":22,"seq":94489280543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303128,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068712,"statfs":{"total":96636764160,"available":96326361088,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.65400000000000003}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.33500000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.73199999999999998}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.495}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.67400000000000004}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55500000000000005}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.70399999999999996}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47299999999999998}]}]},{"osd":8,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.434},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.316}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.42199999999999999}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.45600000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.622},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.48899999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.59099999999999997}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.53100000000000003}]}]},{"osd":9,"up_from":97,"seq":416611827725,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299536,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072304,"statfs":{"total":96636764160,"available":96330039296,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":13,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":15,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":10,"up_from":22,"seq":94489280543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.46300000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.503},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.56899999999999995}]},{"osd":4,"last update":"Wed Sep 18 10:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.72799999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.81799999999999995}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79000000000000004}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.88100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76400000000000001}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.74399999999999999}]}]},{"osd":11,"up_from":22,"seq":94489280542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303132,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068708,"statfs":{"total":96636764160,"available":96326356992,"internally_reserved":0,"allocated":1642496,"data_stored":1233594,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.33800000000000002}]},{"osd":6,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.55700000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46700000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48599999999999999}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.52400000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.64800000000000002}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.54200000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.69399999999999995}]}]},{"osd":12,"up_from":22,"seq":94489280543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298972,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072868,"statfs":{"total":96636764160,"available":96330616832,"internally_reserved":0,"allocated":1646592,"data_stored":1233613,"data_compressed":350257,"data_compressed_allocated":479232,"data_compressed_original":958464,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.435},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.27600000000000002}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.38}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.495}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.313}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.58499999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.54400000000000004}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.41599999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.66400000000000003}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.55500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:18.719 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-18T10:32:24.325171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.719 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-18T10:32:35.935394+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=35, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.719 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-18T10:32:12.279296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=12, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.719 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-18T10:32:15.925761+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=15, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.719 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-18T10:32:11.211201+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=11, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.720 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-18T10:32:14.339076+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=14, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.720 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-18T10:32:23.139765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=32, tm_sec=23, tm_wday=2, tm_yday=262, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=18, tm_hour=10, tm_min=33, tm_sec=10, tm_wday=2, tm_yday=262, tm_isdst=0) 2024-09-18T10:33:18.720 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-18T10:33:38.721 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-18T10:33:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-18T10:33:39.015 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-18T10:33:39.024 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-18T10:33:38.644967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":4827016,"kb_used_data":27132,"kb_used_omap":30,"kb_used_meta":4799649,"kb_avail":1505122424,"statfs":{"total":1546188226560,"available":1541245362176,"internally_reserved":0,"allocated":27783168,"data_stored":21877278,"data_compressed":5964336,"data_compressed_allocated":8196096,"data_compressed_original":17285120,"omap_allocated":30743,"internal_metadata":4914841577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.882048"},"pg_stats":[{"pgid":"1.0","version":"139'114","reported_seq":287,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-18T10:33:35.271958+0000","last_change":"2024-09-18T10:33:16.083356+0000","last_active":"2024-09-18T10:33:35.271958+0000","last_peered":"2024-09-18T10:33:35.271958+0000","last_clean":"2024-09-18T10:33:35.271958+0000","last_became_active":"2024-09-18T10:31:02.823582+0000","last_became_peered":"2024-09-18T10:31:02.823582+0000","last_unstale":"2024-09-18T10:33:35.271958+0000","last_undegraded":"2024-09-18T10:33:35.271958+0000","last_fullsized":"2024-09-18T10:33:35.271958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'114","last_scrub_stamp":"2024-09-18T10:33:16.083274+0000","last_deep_scrub":"139'114","last_deep_scrub_stamp":"2024-09-18T10:33:16.083274+0000","last_clean_scrub_stamp":"2024-09-18T10:33:16.083274+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:32.893476+0000","scrub_duration":0.004394696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"142'2","reported_seq":151,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:33.997554+0000","last_change":"2024-09-18T10:33:26.124396+0000","last_active":"2024-09-18T10:33:33.997554+0000","last_peered":"2024-09-18T10:33:33.997554+0000","last_clean":"2024-09-18T10:33:33.997554+0000","last_became_active":"2024-09-18T10:31:05.180991+0000","last_became_peered":"2024-09-18T10:31:05.180991+0000","last_unstale":"2024-09-18T10:33:33.997554+0000","last_undegraded":"2024-09-18T10:33:33.997554+0000","last_fullsized":"2024-09-18T10:33:33.997554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'2","last_scrub_stamp":"2024-09-18T10:33:26.124292+0000","last_deep_scrub":"142'2","last_deep_scrub_stamp":"2024-09-18T10:33:26.124292+0000","last_clean_scrub_stamp":"2024-09-18T10:33:26.124292+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:40.655451+0000","scrub_duration":0.003325204,"objects_trimmed":0,"snaptrim_duration":0.00034056499999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:34.643770+0000","last_change":"2024-09-18T10:33:18.475392+0000","last_active":"2024-09-18T10:33:34.643770+0000","last_peered":"2024-09-18T10:33:34.643770+0000","last_clean":"2024-09-18T10:33:34.643770+0000","last_became_active":"2024-09-18T10:33:06.096122+0000","last_became_peered":"2024-09-18T10:33:06.096122+0000","last_unstale":"2024-09-18T10:33:34.643770+0000","last_undegraded":"2024-09-18T10:33:34.643770+0000","last_fullsized":"2024-09-18T10:33:34.643770+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:18.475289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:18.475289+0000","last_clean_scrub_stamp":"2024-09-18T10:33:18.475289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:42.563789+0000","scrub_duration":0.0021696150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":149,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:33.997568+0000","last_change":"2024-09-18T10:33:23.167615+0000","last_active":"2024-09-18T10:33:33.997568+0000","last_peered":"2024-09-18T10:33:33.997568+0000","last_clean":"2024-09-18T10:33:33.997568+0000","last_became_active":"2024-09-18T10:31:05.561826+0000","last_became_peered":"2024-09-18T10:31:05.561826+0000","last_unstale":"2024-09-18T10:33:33.997568+0000","last_undegraded":"2024-09-18T10:33:33.997568+0000","last_fullsized":"2024-09-18T10:33:33.997568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:23.167500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:23.167500+0000","last_clean_scrub_stamp":"2024-09-18T10:33:23.167500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:53.047323+0000","scrub_duration":0.002945577,"objects_trimmed":0,"snaptrim_duration":0.00029725999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"139'3","reported_seq":154,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:33.764190+0000","last_change":"2024-09-18T10:33:18.128806+0000","last_active":"2024-09-18T10:33:33.764190+0000","last_peered":"2024-09-18T10:33:33.764190+0000","last_clean":"2024-09-18T10:33:33.764190+0000","last_became_active":"2024-09-18T10:31:05.533803+0000","last_became_peered":"2024-09-18T10:31:05.533803+0000","last_unstale":"2024-09-18T10:33:33.764190+0000","last_undegraded":"2024-09-18T10:33:33.764190+0000","last_fullsized":"2024-09-18T10:33:33.764190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'3","last_scrub_stamp":"2024-09-18T10:33:18.128723+0000","last_deep_scrub":"139'3","last_deep_scrub_stamp":"2024-09-18T10:33:18.128723+0000","last_clean_scrub_stamp":"2024-09-18T10:33:18.128723+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:20.213902+0000","scrub_duration":0.0028056890000000001,"objects_trimmed":0,"snaptrim_duration":0.000764349,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":150,"reported_epoch":145,"state":"active+clean","last_fresh":"2024-09-18T10:33:31.233791+0000","last_change":"2024-09-18T10:33:13.383863+0000","last_active":"2024-09-18T10:33:31.233791+0000","last_peered":"2024-09-18T10:33:31.233791+0000","last_clean":"2024-09-18T10:33:31.233791+0000","last_became_active":"2024-09-18T10:31:05.561318+0000","last_became_peered":"2024-09-18T10:31:05.561318+0000","last_unstale":"2024-09-18T10:33:31.233791+0000","last_undegraded":"2024-09-18T10:33:31.233791+0000","last_fullsized":"2024-09-18T10:33:31.233791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:13.383743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:13.383743+0000","last_clean_scrub_stamp":"2024-09-18T10:33:13.383743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:38.890401+0000","scrub_duration":0.0012564919999999999,"objects_trimmed":0,"snaptrim_duration":0.00037865099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:34.095150+0000","last_change":"2024-09-18T10:33:17.627649+0000","last_active":"2024-09-18T10:33:34.095150+0000","last_peered":"2024-09-18T10:33:34.095150+0000","last_clean":"2024-09-18T10:33:34.095150+0000","last_became_active":"2024-09-18T10:31:05.180815+0000","last_became_peered":"2024-09-18T10:31:05.180815+0000","last_unstale":"2024-09-18T10:33:34.095150+0000","last_undegraded":"2024-09-18T10:33:34.095150+0000","last_fullsized":"2024-09-18T10:33:34.095150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:17.627561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:17.627561+0000","last_clean_scrub_stamp":"2024-09-18T10:33:17.627561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:47.002989+0000","scrub_duration":0.001488458,"objects_trimmed":0,"snaptrim_duration":0.000318583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:34.381767+0000","last_change":"2024-09-18T10:33:15.603336+0000","last_active":"2024-09-18T10:33:34.381767+0000","last_peered":"2024-09-18T10:33:34.381767+0000","last_clean":"2024-09-18T10:33:34.381767+0000","last_became_active":"2024-09-18T10:31:05.535776+0000","last_became_peered":"2024-09-18T10:31:05.535776+0000","last_unstale":"2024-09-18T10:33:34.381767+0000","last_undegraded":"2024-09-18T10:33:34.381767+0000","last_fullsized":"2024-09-18T10:33:34.381767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:15.603271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:15.603271+0000","last_clean_scrub_stamp":"2024-09-18T10:33:15.603271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:17.594465+0000","scrub_duration":0.0015189100000000001,"objects_trimmed":0,"snaptrim_duration":0.00031487900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-18T10:33:33.764202+0000","last_change":"2024-09-18T10:33:21.162703+0000","last_active":"2024-09-18T10:33:33.764202+0000","last_peered":"2024-09-18T10:33:33.764202+0000","last_clean":"2024-09-18T10:33:33.764202+0000","last_became_active":"2024-09-18T10:31:05.533758+0000","last_became_peered":"2024-09-18T10:31:05.533758+0000","last_unstale":"2024-09-18T10:33:33.764202+0000","last_undegraded":"2024-09-18T10:33:33.764202+0000","last_fullsized":"2024-09-18T10:33:33.764202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T10:33:21.162583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T10:33:21.162583+0000","last_clean_scrub_stamp":"2024-09-18T10:33:21.162583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:44.947326+0000","scrub_duration":0.0018463419999999999,"objects_trimmed":0,"snaptrim_duration":0.00033721400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":19850,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303272,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068568,"statfs":{"total":96636764160,"available":96326213632,"internally_reserved":0,"allocated":1794048,"data_stored":1839102,"data_compressed":384281,"data_compressed_allocated":544768,"data_compressed_original":1536000,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6,7,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.28000000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.443},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.34000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41299999999999998},"min":{"1min":0.218,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70799999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39200000000000002},"min":{"1min":0.24399999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.55800000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33500000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53000000000000003,"15min":0.52300000000000002},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80600000000000005,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.751}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91000000000000003,"5min":1.411,"15min":1.411},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92500000000000004,"5min":1.05,"15min":1.05},"last":0.498}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69699999999999995,"5min":1.008,"15min":1.008},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.40100000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69399999999999995}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.49399999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.087,"15min":1.087},"last":0.72299999999999998}]},{"osd":14,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82099999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.60499999999999998}]}]},{"osd":14,"up_from":22,"seq":94489280547,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42899999999999999,"15min":0.42099999999999999},"min":{"1min":0.35399999999999998,"5min":0.221,"15min":0.221},"max":{"1min":0.70199999999999996,"5min":0.749,"15min":0.749},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Sep 18 10:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.437,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76800000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.44600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":1.02,"15min":1.02},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76600000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Wed Sep 18 10:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.47699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.51200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83799999999999997,"5min":1.411,"15min":1.411},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81599999999999995,"5min":1.075,"15min":1.075},"last":0.751}]},{"osd":9,"last update":"Wed Sep 18 10:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.79200000000000004}]},{"osd":10,"last update":"Wed Sep 18 10:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57699999999999996,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.82899999999999996}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79300000000000004,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78000000000000003,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.90500000000000003}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48299999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97099999999999997,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.55700000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.94799999999999995,"5min":1.109,"15min":1.109},"last":0.91800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86699999999999999,"5min":1.254,"15min":1.254},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.872,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.77600000000000002}]}]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1732608,"data_stored":1300633,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.627}]},{"osd":3,"last update":"Wed Sep 18 10:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82999999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85799999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.60999999999999999,"15min":0.64100000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.625,"15min":0.64500000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.74099999999999999,"5min":1.256,"15min":1.256},"last":0.317}]},{"osd":6,"last update":"Wed Sep 18 10:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85999999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.628},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70799999999999996}]},{"osd":8,"last update":"Wed Sep 18 10:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64000000000000001,"15min":0.65200000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80000000000000004,"5min":1.002,"15min":1.002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81299999999999994,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67600000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95899999999999996,"5min":1.177,"15min":1.177},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.432}]},{"osd":11,"last update":"Wed Sep 18 10:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.96199999999999997,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.64000000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.014,"15min":1.014},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.82299999999999995,"15min":0.84699999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.61699999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0169999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.81799999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.056},"last":0.46999999999999997}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.84599999999999997,"15min":0.87},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98899999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82999999999999996,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.111,"15min":1.111},"last":0.58999999999999997}]}]},{"osd":0,"up_from":21,"seq":90194313251,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,5,6,7,8,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.30399999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70599999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.755,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71399999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59999999999999998,"5min":1.349,"15min":1.349},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":1.236,"15min":1.236},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.75,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":1.137,"15min":1.137},"last":0.875}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.51000000000000001,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79000000000000004,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.28199999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.93500000000000005,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.45600000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88300000000000001,"5min":1.212,"15min":1.212},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.67000000000000004},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91800000000000004,"5min":1.29,"15min":1.29},"last":1.0429999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:33:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.52800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.83499999999999996}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.50900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.75},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":1.167,"15min":1.167},"last":0.85299999999999998}]}]},{"osd":1,"up_from":21,"seq":90194313252,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":299032,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072808,"statfs":{"total":96636764160,"available":96330555392,"internally_reserved":0,"allocated":1716224,"data_stored":1291054,"data_compressed":368328,"data_compressed_allocated":503808,"data_compressed_original":1007616,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.623,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.308},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.50800000000000001,"15min":0.52300000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.622,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.92200000000000004,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85599999999999998,"5min":2.077,"15min":2.077},"last":0.59199999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88400000000000001,"5min":1.329,"15min":1.329},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81799999999999995,"5min":1.766,"15min":1.766},"last":0.437},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.98899999999999999,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.42199999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46600000000000003,"15min":0.47399999999999998},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.67500000000000004,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.46400000000000002,"15min":0.47599999999999998},"min":{"1min":0.28000000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63500000000000001,"5min":1.99,"15min":1.99},"last":0.32100000000000001}]},{"osd":6,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86199999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95599999999999996,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.63}]},{"osd":7,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.42199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83999999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51600000000000001}]},{"osd":12,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.59999999999999998,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.313,"15min":0.313},"max":{"1min":6.2539999999999996,"5min":6.2539999999999996,"15min":6.2539999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76000000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38300000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.84199999999999997,"5min":2.302,"15min":2.302},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.60599999999999998}]},{"osd":15,"last update":"Wed Sep 18 10:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.82799999999999996,"5min":1.256,"15min":1.256},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.41299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98899999999999999,"5min":2.371,"15min":2.371},"last":0.496}]}]},{"osd":4,"up_from":21,"seq":90194313252,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303192,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068648,"statfs":{"total":96636764160,"available":96326295552,"internally_reserved":0,"allocated":1716224,"data_stored":1291054,"data_compressed":368328,"data_compressed_allocated":503808,"data_compressed_original":1007616,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,3,5,6,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.80600000000000005,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60399999999999998}]},{"osd":1,"last update":"Wed Sep 18 10:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:32:18 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":1.153,"15min":1.153},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66500000000000004,"15min":0.68300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77900000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.67500000000000004,"15min":0.69099999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69499999999999995,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.755,"15min":0.755},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":1.119,"15min":1.119},"last":0.76700000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":9,"last update":"Wed Sep 18 10:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.92800000000000005}]},{"osd":10,"last update":"Wed Sep 18 10:32:03 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.71899999999999997}]},{"osd":11,"last update":"Wed Sep 18 10:33:20 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82199999999999995,"15min":0.83099999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":0.89900000000000002}]},{"osd":12,"last update":"Wed Sep 18 10:33:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.97099999999999997,"5min":1.194,"15min":1.194},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.753}]},{"osd":13,"last update":"Wed Sep 18 10:33:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.82699999999999996,"15min":0.84299999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.016,"5min":1.292,"15min":1.292},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79700000000000004,"15min":0.80600000000000005},"min":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.88100000000000001}]},{"osd":14,"last update":"Wed Sep 18 10:33:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.84399999999999997,"15min":0.85399999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0609999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84599999999999997,"15min":0.85199999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":1.075}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.93600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.109},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.89200000000000002,"15min":0.92200000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.90900000000000003,"5min":1.381,"15min":1.381},"last":0.95499999999999996}]}]},{"osd":2,"up_from":22,"seq":94489280547,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303220,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068620,"statfs":{"total":96636764160,"available":96326266880,"internally_reserved":0,"allocated":1740800,"data_stored":1310174,"data_compressed":374356,"data_compressed_allocated":512000,"data_compressed_original":1024000,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,3,4,5,6,7,8,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.499},"min":{"1min":0.26700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65800000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.872,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53800000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.32200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72699999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.94299999999999995,"5min":1.018,"15min":1.018},"last":0.85799999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42299999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.32200000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81000000000000005}]},{"osd":8,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.46100000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73199999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":10,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78100000000000003}]},{"osd":12,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.66300000000000003,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.64400000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.84199999999999997}]},{"osd":13,"last update":"Wed Sep 18 10:33:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88300000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.875}]}]},{"osd":3,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,4,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63900000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54800000000000004,"15min":0.55100000000000005},"min":{"1min":0.32700000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.71199999999999997,"5min":1.02,"15min":1.02},"last":0.5}]},{"osd":4,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79400000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.629,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.47399999999999998,"15min":0.48499999999999999},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.496,"15min":0.502},"min":{"1min":0.30399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.84699999999999998,"5min":0.876,"15min":0.876},"last":0.39900000000000002}]},{"osd":8,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85599999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.83599999999999997}]},{"osd":9,"last update":"Wed Sep 18 10:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60699999999999998}]},{"osd":10,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1,"5min":1,"15min":1},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65700000000000003,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96399999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.76200000000000001}]},{"osd":13,"last update":"Wed Sep 18 10:33:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.81899999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70199999999999996}]},{"osd":15,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66200000000000003,"15min":0.65800000000000003},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.45000000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005}]}]},{"osd":5,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299044,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072796,"statfs":{"total":96636764160,"available":96330543104,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,4,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.501},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35599999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88},"last":0.432}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.82599999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.624}]},{"osd":8,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53900000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68700000000000006,"15min":0.69199999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83899999999999997,"5min":1.004,"15min":1.004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.84599999999999997,"5min":1.038,"15min":1.038},"last":0.59299999999999997}]},{"osd":12,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78000000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.377}]},{"osd":13,"last update":"Wed Sep 18 10:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.86499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.33700000000000002}]},{"osd":14,"last update":"Wed Sep 18 10:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77800000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.72399999999999998,"15min":0.71999999999999997},"min":{"1min":0.59399999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.81899999999999995,"5min":1.224,"15min":1.224},"last":0.56999999999999995}]}]},{"osd":6,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303256,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068584,"statfs":{"total":96636764160,"available":96326230016,"internally_reserved":0,"allocated":1781760,"data_stored":1829542,"data_compressed":381267,"data_compressed_allocated":540672,"data_compressed_original":1527808,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,5,7,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.39800000000000002,"15min":0.38700000000000001},"min":{"1min":0.27600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.38800000000000001,"15min":0.378},"min":{"1min":0.35399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.78900000000000003}]},{"osd":1,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.872,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57599999999999996}]},{"osd":3,"last update":"Wed Sep 18 10:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.49099999999999999,"15min":0.47099999999999997},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.50700000000000001,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.84199999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63100000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.55600000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72599999999999998,"5min":0.874,"15min":0.874},"last":0.52600000000000002}]},{"osd":7,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89700000000000002,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.752},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81999999999999995,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.92100000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":11,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.022,"5min":1.266,"15min":1.266},"last":0.84699999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55700000000000005,"15min":0.55600000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.879},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.377,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.91800000000000004,"5min":1.024,"15min":1.024},"last":0.72299999999999998}]},{"osd":13,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96599999999999997,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82899999999999996}]},{"osd":14,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88500000000000001,"5min":1.165,"15min":1.165},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.31900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.83499999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.44700000000000001}]},{"osd":15,"last update":"Wed Sep 18 10:33:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.47399999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.97699999999999998,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0609999999999999,"5min":1.226,"15min":1.226},"last":0.86399999999999999}]}]},{"osd":7,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303204,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068636,"statfs":{"total":96636764160,"available":96326283264,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[2,3,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:33:25 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.498,"15min":0.48699999999999999},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.52700000000000002,"15min":0.51400000000000001},"min":{"1min":0.32100000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82599999999999996,"5min":1.018,"15min":1.018},"last":0.59099999999999997}]},{"osd":3,"last update":"Wed Sep 18 10:33:25 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.27400000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":4,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.40200000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47599999999999998}]},{"osd":5,"last update":"Wed Sep 18 10:33:25 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.496,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.58799999999999997,"15min":0.57499999999999996},"min":{"1min":0.44400000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72999999999999998}]},{"osd":6,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.435,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.38100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64300000000000002}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.46600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.53200000000000003,"15min":0.51500000000000001},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46600000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64300000000000002,"15min":0.63700000000000001},"min":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":1.069,"15min":1.069},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.76800000000000002}]},{"osd":11,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81499999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.49099999999999999}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1,"5min":1,"15min":1},"last":0.747},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78000000000000003}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0469999999999999,"5min":1.173,"15min":1.173},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.68799999999999994,"15min":0.67600000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67000000000000004}]}]},{"osd":8,"up_from":22,"seq":94489280548,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299044,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072796,"statfs":{"total":96636764160,"available":96330543104,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":2,"last update":"Wed Sep 18 10:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.499,"15min":0.499},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.75,"15min":0.75},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40600000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72499999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67000000000000004,"5min":1.01,"15min":1.01},"last":0.66400000000000003}]},{"osd":4,"last update":"Wed Sep 18 10:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.55600000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.39800000000000002,"15min":0.40200000000000002},"min":{"1min":0.27800000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.433}]},{"osd":6,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.33900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":1.04,"15min":1.04},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79700000000000004}]},{"osd":7,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67400000000000004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.57899999999999996},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77700000000000002}]},{"osd":9,"last update":"Wed Sep 18 10:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.026}]},{"osd":10,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.45400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80000000000000004,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76800000000000002,"5min":1.3,"15min":1.3},"last":0.95399999999999996}]},{"osd":11,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.433,"15min":0.433},"max":{"1min":0.85599999999999998,"5min":0.873,"15min":0.873},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.45800000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.73799999999999999,"5min":0.875,"15min":0.875},"last":0.81899999999999995}]},{"osd":12,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":13,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92500000000000004,"5min":1.254,"15min":1.254},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.121,"15min":1.121},"last":0.86699999999999999}]},{"osd":14,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":15,"last update":"Wed Sep 18 10:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81299999999999994,"5min":1.486,"15min":1.486},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.53000000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82699999999999996,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.98199999999999998}]}]},{"osd":9,"up_from":97,"seq":416611827729,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299620,"kb_used_data":1688,"kb_used_omap":5,"kb_used_meta":297914,"kb_avail":94072220,"statfs":{"total":96636764160,"available":96329953280,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":5183,"internal_metadata":305064897},"hb_peers":[0,3,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.63400000000000001}]},{"osd":8,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.66000000000000003}]},{"osd":10,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.81200000000000006}]},{"osd":11,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71399999999999997}]},{"osd":12,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.89900000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.69699999999999995}]},{"osd":14,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.77800000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.008},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.97299999999999998}]}]},{"osd":10,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299044,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072796,"statfs":{"total":96636764160,"available":96330543104,"internally_reserved":0,"allocated":1728512,"data_stored":1300614,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[2,3,4,5,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36799999999999999,"15min":0.372},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.47799999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.37},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.375,"15min":0.376},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.55600000000000005,"15min":0.54000000000000004},"min":{"1min":0.36299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.498}]},{"osd":4,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.75700000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.497,"15min":0.495},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.621,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.63200000000000001}]},{"osd":5,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Wed Sep 18 10:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.434}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.01,"5min":1.123,"15min":1.123},"last":0.48199999999999998}]},{"osd":12,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84899999999999998,"5min":0.87,"15min":0.87},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42799999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94299999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59099999999999997}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85899999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65300000000000002}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.69299999999999995,"15min":0.68400000000000005},"min":{"1min":0.53100000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97299999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69199999999999995}]}]},{"osd":11,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303220,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94068620,"statfs":{"total":96636764160,"available":96326266880,"internally_reserved":0,"allocated":1740800,"data_stored":1310174,"data_compressed":374356,"data_compressed_allocated":512000,"data_compressed_original":1024000,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,6,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.755,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88100000000000001}]},{"osd":3,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41799999999999998,"15min":0.42399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57899999999999996,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40799999999999997,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.379}]},{"osd":6,"last update":"Wed Sep 18 10:33:20 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.95999999999999996}]},{"osd":8,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.79900000000000004}]},{"osd":10,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.67500000000000004}]},{"osd":12,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92400000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.90000000000000002}]},{"osd":13,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.022,"5min":1.147,"15min":1.147},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0089999999999999,"5min":1.081,"15min":1.081},"last":0.65800000000000003}]},{"osd":14,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.81499999999999995}]},{"osd":15,"last update":"Wed Sep 18 10:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.39100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.84899999999999998}]}]},{"osd":12,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299048,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94072792,"statfs":{"total":96636764160,"available":96330539008,"internally_reserved":0,"allocated":1732608,"data_stored":1300633,"data_compressed":371342,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34300000000000003,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.47199999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.36499999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.47799999999999998,"5min":0.626,"15min":0.626},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.35399999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66400000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57799999999999996}]},{"osd":2,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52100000000000002,"15min":0.50900000000000001},"min":{"1min":0.39600000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77500000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.78400000000000003,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71099999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84299999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64600000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.623}]},{"osd":6,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.75800000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.083},"last":0.66900000000000004}]},{"osd":11,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.48599999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82899999999999996,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.42999999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79200000000000004,"5min":1.056,"15min":1.056},"last":0.81299999999999994}]},{"osd":13,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76500000000000001,"5min":1.028,"15min":1.028},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.81499999999999995,"5min":1.159,"15min":1.159},"last":0.73999999999999999}]},{"osd":14,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.86899999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.495,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89200000000000002,"5min":1.181,"15min":1.181},"last":0.871}]},{"osd":15,"last update":"Wed Sep 18 10:33:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.68500000000000005,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.89400000000000002,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.44,"15min":0.44},"max":{"1min":0.85699999999999998,"5min":1.399,"15min":1.399},"last":0.82599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9925,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T10:33:39.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-18T10:33:39.322 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-18T10:33:39.322 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-18T10:33:39.322 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-18T10:33:39.322 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.364 INFO:tasks.ceph.osd.0:Stopped 2024-09-18T10:33:39.364 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-18T10:33:39.364 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.405 INFO:tasks.ceph.osd.4:Stopped 2024-09-18T10:33:39.406 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-09-18T10:33:39.406 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.442 INFO:tasks.ceph.osd.8:Stopped 2024-09-18T10:33:39.442 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-09-18T10:33:39.443 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.511 INFO:tasks.ceph.osd.12:Stopped 2024-09-18T10:33:39.511 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-18T10:33:39.511 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.550 INFO:tasks.ceph.osd.1:Stopped 2024-09-18T10:33:39.551 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-18T10:33:39.551 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.624 INFO:tasks.ceph.osd.5:Stopped 2024-09-18T10:33:39.625 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-09-18T10:33:39.625 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.697 INFO:tasks.ceph.osd.9:Stopped 2024-09-18T10:33:39.697 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2024-09-18T10:33:39.698 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.766 INFO:tasks.ceph.osd.13:Stopped 2024-09-18T10:33:39.767 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-18T10:33:39.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.802 INFO:tasks.ceph.osd.2:Stopped 2024-09-18T10:33:39.802 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-18T10:33:39.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.871 INFO:tasks.ceph.osd.6:Stopped 2024-09-18T10:33:39.871 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-09-18T10:33:39.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:39.941 INFO:tasks.ceph.osd.10:Stopped 2024-09-18T10:33:39.941 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-09-18T10:33:39.941 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.010 INFO:tasks.ceph.osd.14:Stopped 2024-09-18T10:33:40.011 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-18T10:33:40.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.045 INFO:tasks.ceph.osd.3:Stopped 2024-09-18T10:33:40.045 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-18T10:33:40.045 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.125 INFO:tasks.ceph.osd.7:Stopped 2024-09-18T10:33:40.125 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-09-18T10:33:40.125 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.206 INFO:tasks.ceph.osd.11:Stopped 2024-09-18T10:33:40.206 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2024-09-18T10:33:40.207 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.280 INFO:tasks.ceph.osd.15:Stopped 2024-09-18T10:33:40.280 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-18T10:33:40.281 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-18T10:33:40.281 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.308 INFO:tasks.ceph.mgr.y:Stopped 2024-09-18T10:33:40.308 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-18T10:33:40.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.350 INFO:tasks.ceph.mgr.x:Stopped 2024-09-18T10:33:40.350 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-18T10:33:40.351 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-18T10:33:40.351 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.364 INFO:tasks.ceph.mon.a:Stopped 2024-09-18T10:33:40.364 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-18T10:33:40.364 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.378 INFO:tasks.ceph.mon.b:Stopped 2024-09-18T10:33:40.378 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-18T10:33:40.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T10:33:40.392 INFO:tasks.ceph.mon.c:Stopped 2024-09-18T10:33:40.392 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-18T10:33:40.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'slow request' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-18T10:33:40.442 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:33:40.442 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-18T10:33:40.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:33:40.622 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-18T10:33:40.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:33:40.730 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-09-18T10:33:40.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:33:40.802 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2024-09-18T10:33:40.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:33:40.970 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-18T10:33:41.100 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:33:41.101 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-18T10:33:41.206 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:33:41.206 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-09-18T10:33:41.273 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:33:41.273 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2024-09-18T10:33:41.338 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:33:41.339 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-18T10:33:41.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:33:41.468 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-18T10:33:41.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:33:41.557 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-09-18T10:33:41.621 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:33:41.621 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2024-09-18T10:33:41.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:33:41.689 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-18T10:33:41.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:33:41.813 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-18T10:33:41.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:33:41.894 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-09-18T10:33:41.950 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:33:41.950 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2024-09-18T10:33:42.008 INFO:tasks.ceph:Archiving mon data... 2024-09-18T10:33:42.009 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/data/mon.a.tgz 2024-09-18T10:33:42.009 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-18T10:33:42.029 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.Llqj4i7khQ 2024-09-18T10:33:42.029 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Llqj4i7khQ 2024-09-18T10:33:42.195 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.Llqj4i7khQ 2024-09-18T10:33:42.280 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.Llqj4i7khQ is 407KB 2024-09-18T10:33:42.379 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.Llqj4i7khQ 2024-09-18T10:33:42.395 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/data/mon.b.tgz 2024-09-18T10:33:42.395 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-18T10:33:42.414 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.J76HueMtDm 2024-09-18T10:33:42.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.J76HueMtDm 2024-09-18T10:33:42.615 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.J76HueMtDm 2024-09-18T10:33:42.698 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.J76HueMtDm is 582KB 2024-09-18T10:33:42.803 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.J76HueMtDm 2024-09-18T10:33:42.818 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/data/mon.c.tgz 2024-09-18T10:33:42.818 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-18T10:33:42.837 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.LskncLi3XA 2024-09-18T10:33:42.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LskncLi3XA 2024-09-18T10:33:43.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.LskncLi3XA 2024-09-18T10:33:43.144 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.LskncLi3XA is 582KB 2024-09-18T10:33:43.254 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.LskncLi3XA 2024-09-18T10:33:43.269 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-18T10:33:43.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T10:33:43.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T10:33:43.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T10:33:43.311 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-18T10:33:43.341 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-18T10:33:43.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T10:33:43.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T10:33:43.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T10:33:43.371 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T10:33:43.375 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T10:33:43.377 DEBUG:teuthology.orchestra.run.smithi160:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-18T10:33:43.400 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T10:33:43.412 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-18T10:33:43.417 INFO:tasks.ceph:Archiving crash dumps... 2024-09-18T10:33:43.419 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi063/crash 2024-09-18T10:33:43.420 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T10:33:43.451 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi071/crash 2024-09-18T10:33:43.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T10:33:43.477 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi100/crash 2024-09-18T10:33:43.477 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T10:33:43.502 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi160/crash 2024-09-18T10:33:43.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-18T10:33:43.538 INFO:tasks.ceph:Compressing logs... 2024-09-18T10:33:43.538 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T10:33:43.541 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T10:33:43.543 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T10:33:43.546 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T10:33:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.39510.log 2024-09-18T10:33:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-18T10:33:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.37826.log 2024-09-18T10:33:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/objectstore_tool.39510.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bluestore_tool.44503.log 2024-09-18T10:33:43.566 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/objectstore_tool.37826.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-09-18T10:33:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2024-09-18T10:33:43.567 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/bluestore_tool.44503.log: /var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T10:33:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-09-18T10:33:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T10:33:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-18T10:33:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-18T10:33:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2024-09-18T10:33:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-18T10:33:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T10:33:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.6.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T10:33:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T10:33:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.40272.log 2024-09-18T10:33:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/objectstore_tool.40272.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T10:33:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/bluestore_tool.43563.log 2024-09-18T10:33:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-18T10:33:43.579 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/bluestore_tool.43563.log: 45.3% -- replaced with /var/log/ceph/bluestore_tool.43563.log.gz 2024-09-18T10:33:43.579 INFO:teuthology.orchestra.run.smithi071.stderr: 93.1% -- replaced with /var/log/ceph/bluestore_tool.44503.log.gz 2024-09-18T10:33:43.580 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T10:33:43.580 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-18T10:33:43.580 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T10:33:43.580 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/bluestore_tool.43600.log 2024-09-18T10:33:43.593 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.b.log: 93.5%gzip -5 --verbose -- /var/log/ceph/objectstore_tool..log 2024-09-18T10:33:43.593 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/bluestore_tool.43600.log: -- replaced with /var/log/ceph/objectstore_tool.39510.log.gz 2024-09-18T10:33:43.593 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/objectstore_tool.40272.log.gz 2024-09-18T10:33:43.593 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/bluestore_tool.43600.log.gz 2024-09-18T10:33:43.593 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38748.log 2024-09-18T10:33:43.593 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/objectstore_tool..log: gzip -5 --verbose -- /var/log/ceph/bluestore_tool.44093.log 2024-09-18T10:33:43.601 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/objectstore_tool.38748.log: 93.7% -- replaced with /var/log/ceph/objectstore_tool.37826.log.gz 2024-09-18T10:33:43.615 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/bluestore_tool.44093.log: 93.4% -- replaced with /var/log/ceph/bluestore_tool.44093.log.gz 2024-09-18T10:33:43.615 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/objectstore_tool.38748.log.gz 2024-09-18T10:33:43.631 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36501.log 2024-09-18T10:33:43.631 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32392.log 2024-09-18T10:33:43.631 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32712.log 2024-09-18T10:33:43.631 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.0.36501.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.36501.log.gz 2024-09-18T10:33:43.631 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32392.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-18T10:33:43.631 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32392.log.gz 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32552.log 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32712.log.gz 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32552.log.gz 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32832.log 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32906.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32350.log 2024-09-18T10:33:43.632 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32832.log.gz 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32592.log 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32301.log 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32350.log.gz 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32792.log 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32592.log.gz 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32301.log.gz 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32792.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32792.log.gz 2024-09-18T10:33:43.633 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32261.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32472.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32752.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32261.log.gz 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32472.log.gz 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32672.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32432.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-18T10:33:43.634 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-09-18T10:33:43.635 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32672.log.gz 2024-09-18T10:33:43.647 INFO:teuthology.orchestra.run.smithi071.stderr: 93.5% -- replaced with /var/log/ceph/objectstore_tool..log.gz 2024-09-18T10:33:43.665 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.3.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-18T10:33:43.696 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-18T10:33:43.699 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47003.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37440.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.47003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47003.log.gz 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37440.log.gz 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36905.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39670.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48460.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36905.log.gz 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47255.log 2024-09-18T10:33:43.700 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39670.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48460.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48011.log 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47255.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37982.log 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42901.log 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48011.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42581.log 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37982.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40757.log 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42901.log.gz 2024-09-18T10:33:43.701 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.42581.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49817.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.40757.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37416.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49817.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40382.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45444.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37416.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40322.log 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40382.log.gz 2024-09-18T10:33:43.702 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.45444.log.gz 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40322.log.gz 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39031.log 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48444.log 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50279.log 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39031.log.gz 2024-09-18T10:33:43.703 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47507.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48444.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40845.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50279.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46620.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47507.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40845.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46620.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-09-18T10:33:43.704 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46535.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42499.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43221.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46535.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47465.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42499.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47969.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.43221.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47465.log.gz 2024-09-18T10:33:43.705 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46793.log 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47969.log.gz 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48137.log 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46793.log.gz 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33630.log 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48137.log.gz 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37431.log 2024-09-18T10:33:43.706 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33630.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37431.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38037.log 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49037.log 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46578.log 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38037.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49037.log.gz 2024-09-18T10:33:43.707 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38693.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46578.log.gz 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46919.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49042.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38693.log.gz 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38071.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49042.log.gz 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38071.log.gz 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43147.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38947.log 2024-09-18T10:33:43.708 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43147.log: gzip 22.4% -- replaced with /var/log/ceph/ceph-client.admin.43147.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50111.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37885.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38947.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50111.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38505.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37885.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39755.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47885.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38505.log.gz 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2024-09-18T10:33:43.709 INFO:teuthology.orchestra.run.smithi063.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.39755.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47171.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47885.log: /var/log/ceph/ceph-client.admin.46115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47885.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43105.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47171.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49101.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42519.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43105.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50783.log 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42519.log.gz 2024-09-18T10:33:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gzgzip 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48450.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50153.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48450.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42800.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50153.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46337.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42800.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42800.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38653.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.46337.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50321.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2024-09-18T10:33:43.711 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38821.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38653.log.gz 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41026.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38821.log.gz 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50909.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39214.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41026.log.gz 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49075.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50909.log.gz 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39214.log.gz 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41999.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49149.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49075.log.gz 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41999.log.gzgzip 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-18T10:33:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51287.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49149.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39596.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51287.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37415.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49027.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39596.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37415.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49027.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39215.log 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49027.log.gz 2024-09-18T10:33:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39215.log.gz 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37408.log 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44603.log 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41552.log 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37408.log.gz 2024-09-18T10:33:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.44603.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50069.log 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41552.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41552.log.gz -5 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47801.log 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50069.log.gz 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47801.log.gz 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-09-18T10:33:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48427.log 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44358.log: 25.6% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38485.log 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48427.log.gz 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49052.log 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49046.log 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38485.log.gz 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45311.log 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49052.log.gz 2024-09-18T10:33:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49046.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45311.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49543.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49733.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33226.log 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49543.log.gz 2024-09-18T10:33:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46494.log 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49733.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39691.log 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33226.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48904.log 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46494.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39691.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.48470.log -- replaced with /var/log/ceph/ceph-client.admin.39691.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48904.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37938.log 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50741.log 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-09-18T10:33:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44824.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37938.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50741.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44824.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51119.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42650.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45982.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51119.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44979.log 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42650.log.gz 2024-09-18T10:33:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37015.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.45982.log.gz 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49026.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36843.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37015.log.gz 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49026.log.gz 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37428.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40737.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36843.log.gz 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37428.log.gz 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27351.log 2024-09-18T10:33:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40737.log.gz 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46751.log 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gz 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.27351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27351.log.gz 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43278.log 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46751.log.gz 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38692.log 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38179.log 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43278.log.gz 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-09-18T10:33:43.721 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38692.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41719.log 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38179.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38007.log 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41719.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50573.log 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38007.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46704.log 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45940.log 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50573.log.gz 2024-09-18T10:33:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46704.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48095.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45940.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33491.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48095.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49607.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33491.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49319.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49607.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49319.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-18T10:33:43.723 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49319.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47339.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40152.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.47339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37953.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47339.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50867.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.40152.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37953.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49901.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50867.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38989.log 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2024-09-18T10:33:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39890.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49901.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38989.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46452.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39890.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49859.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50699.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46452.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41532.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49859.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50699.log.gz 2024-09-18T10:33:43.725 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41532.log.gz 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40977.log 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38863.log 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40977.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.40977.log.gz/var/log/ceph/ceph-client.admin.37937.log: 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 26.0% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51369.log 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39775.log 2024-09-18T10:33:43.726 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38863.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50825.log 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51369.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44122.log 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39775.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50825.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51035.log 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44122.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39493.log 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51035.log.gz 2024-09-18T10:33:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49985.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39493.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50951.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49985.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39213.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50951.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45869.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39213.log: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.39213.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41417.log 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.45869.log.gz 2024-09-18T10:33:43.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41417.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr: 50.1% -- replaced with /var/log/ceph/ceph-client.admin.41417.log.gz 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37427.log 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.46406.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51161.log 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37427.log.gz 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51203.log 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5/var/log/ceph/ceph-client.admin.51161.log: --verbose -- /var/log/ceph/ceph-client.admin.48447.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51161.log.gz 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-18T10:33:43.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51203.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48053.log 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48053.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48053.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.48454.log 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41275.log 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41275.log: 92.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37383.log 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41275.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43733.log: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-18T10:33:43.730 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46877.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47927.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37383.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46877.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46877.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38033.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48478.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47927.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37441.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38033.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48478.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48478.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49006.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37441.log.gz 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37099.log 2024-09-18T10:33:43.731 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47129.log 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49006.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40225.log 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37099.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37420.log 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47129.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40225.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43591.log 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37420.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49050.log 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-09-18T10:33:43.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43591.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43591.log.gz 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49050.log.gz 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.48459.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47591.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gz 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.37407.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.48469.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47591.log.gz 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37384.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49649.log 2024-09-18T10:33:43.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48469.log.gz 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37384.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37384.log.gz 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38779.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49649.log.gz 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-osd.8.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38779.log.gz 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43848.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.44937.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45403.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40267.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.43848.log.gz 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38118.log 2024-09-18T10:33:43.734 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45403.log: /var/log/ceph/ceph-client.admin.40267.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45403.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.40267.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50363.log 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38118.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50489.log 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50363.log: /var/log/ceph/ceph-client.admin.50489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49175.log 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50489.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50363.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47549.log 2024-09-18T10:33:43.735 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49175.log.gz 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41437.log 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47549.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47549.log.gz 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.51329.log 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41437.log.gz 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37436.log 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49523.log 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37436.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37436.log.gz 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.42258.log 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49523.log.gz 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50447.log 2024-09-18T10:33:43.736 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42258.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42258.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.42984.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50447.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38905.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42984.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.47381.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38905.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47381.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.51245.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43806.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51245.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51245.log.gz 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.47717.log 2024-09-18T10:33:43.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43806.log.gz 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37389.log 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47717.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51077.log 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37389.log.gz 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40523.log 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.51077.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51077.log.gz 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50405.log 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40523.log.gz 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50615.log 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50405.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50405.log.gz 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.37870.log 2024-09-18T10:33:43.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50615.log.gz 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44398.log 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37870.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37870.log.gz 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.38559.log 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44398.log.gz 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50993.log 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38559.log.gz 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.47213.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50993.log.gz 2024-09-18T10:33:43.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-09-18T10:33:43.740 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-18T10:33:43.821 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-09-18T10:33:43.856 INFO:teuthology.orchestra.run.smithi063.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2024-09-18T10:33:43.875 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-09-18T10:33:43.876 INFO:teuthology.orchestra.run.smithi071.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-18T10:33:43.876 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-18T10:33:43.911 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-18T10:33:43.958 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-18T10:33:43.974 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2024-09-18T10:33:43.998 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-18T10:33:44.004 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-18T10:33:44.024 INFO:teuthology.orchestra.run.smithi160.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-09-18T10:33:44.033 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2024-09-18T10:33:44.036 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-18T10:33:44.036 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.477s 2024-09-18T10:33:44.036 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m1.633s 2024-09-18T10:33:44.036 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.087s 2024-09-18T10:33:44.041 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-09-18T10:33:44.090 INFO:teuthology.orchestra.run.smithi063.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-18T10:33:44.113 INFO:teuthology.orchestra.run.smithi071.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2024-09-18T10:33:44.115 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-18T10:33:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m0.559s 2024-09-18T10:33:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m1.777s 2024-09-18T10:33:44.115 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.075s 2024-09-18T10:33:44.116 INFO:teuthology.orchestra.run.smithi160.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-18T10:33:44.118 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-18T10:33:44.118 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m0.521s 2024-09-18T10:33:44.118 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m1.628s 2024-09-18T10:33:44.118 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.083s 2024-09-18T10:33:44.252 INFO:teuthology.orchestra.run.smithi063.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-18T10:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-18T10:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m0.699s 2024-09-18T10:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m2.128s 2024-09-18T10:33:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.228s 2024-09-18T10:33:44.255 INFO:tasks.ceph:Archiving logs... 2024-09-18T10:33:44.255 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi063/log 2024-09-18T10:33:44.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T10:33:44.821 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi071/log 2024-09-18T10:33:44.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T10:33:45.117 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi100/log 2024-09-18T10:33:45.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T10:33:45.415 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi160/log 2024-09-18T10:33:45.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T10:33:45.737 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T10:33:45.746 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T10:33:45.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T10:33:45.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T10:33:45.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T10:33:45.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T10:33:45.878 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T10:33:45.887 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T10:33:45.888 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:33:45.890 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:33:45.893 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:33:45.895 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T10:33:45.906 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:33:45.907 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:33:45.909 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:33:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:33:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-18T10:33:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -315us[ -307us] +/- 46ms 2024-09-18T10:33:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 +1218us[+1226us] +/- 59ms 2024-09-18T10:33:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -1171us[-1163us] +/- 86ms 2024-09-18T10:33:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:33:45.912 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-18T10:33:45.913 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:33:45.913 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-18T10:33:45.913 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -316us[ -312us] +/- 46ms 2024-09-18T10:33:45.913 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +1230us[+1234us] +/- 59ms 2024-09-18T10:33:45.913 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1159us[-1159us] +/- 86ms 2024-09-18T10:33:45.913 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:33:45.914 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:33:45.914 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-18T10:33:45.915 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -302us[ -289us] +/- 46ms 2024-09-18T10:33:45.915 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 +1222us[+1222us] +/- 59ms 2024-09-18T10:33:45.915 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1158us[-1158us] +/- 86ms 2024-09-18T10:33:45.915 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:33:45.916 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T10:33:45.916 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-18T10:33:45.916 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -314us[ -310us] +/- 46ms 2024-09-18T10:33:45.916 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 +1217us[+1220us] +/- 59ms 2024-09-18T10:33:45.916 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1170us[-1166us] +/- 86ms 2024-09-18T10:33:45.916 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T10:33:45.917 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T10:33:45.926 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T10:33:45.926 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T10:33:45.938 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T10:33:46.033 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T10:33:46.104 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T10:33:46.173 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T10:33:46.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:33:46.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:46.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:33:46.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:46.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:33:46.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:46.339 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-18T10:33:46.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:46.369 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T10:33:46.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T10:33:46.389 INFO:teuthology.task.internal:Duration was 627.275678 seconds 2024-09-18T10:33:46.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T10:33:46.398 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T10:33:46.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T10:33:46.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T10:33:46.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T10:33:46.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T10:33:46.443 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:33:46.444 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:33:46.445 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:33:46.450 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T10:33:46.870 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T10:33:46.870 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-18T10:33:46.871 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T10:33:46.895 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-18T10:33:46.896 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T10:33:46.923 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-18T10:33:46.923 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T10:33:46.946 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-09-18T10:33:46.946 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T10:33:46.971 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T10:33:46.971 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T10:33:46.974 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T10:33:46.976 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T10:33:46.988 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T10:33:47.039 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T10:33:47.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T10:33:47.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T10:33:47.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T10:33:47.055 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T10:33:47.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T10:33:47.196 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T10:33:47.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T10:33:47.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T10:33:47.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T10:33:47.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T10:33:47.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T10:33:47.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.314 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.330 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-18T10:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-18T10:33:47.334 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-18T10:33:47.360 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-09-18T10:33:47.387 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:47.405 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:47.420 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:47.435 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T10:33:47.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T10:33:47.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T10:33:47.460 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T10:33:47.460 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi063 2024-09-18T10:33:47.461 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T10:33:47.498 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi071 2024-09-18T10:33:47.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T10:33:47.532 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi100 2024-09-18T10:33:47.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T10:33:47.569 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-18_09:13:00-rados-wip-bharath11-testing-2024-09-18-1115-quincy-distro-default-smithi/7910874/remote/smithi160 2024-09-18T10:33:47.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T10:33:47.603 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T10:33:47.603 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T10:33:47.605 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T10:33:47.608 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T10:33:47.610 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T10:33:47.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T10:33:47.666 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T10:33:47.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T10:33:47.676 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T10:33:47.676 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T10:33:47.679 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T10:33:47.681 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T10:33:47.683 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T10:33:47.692 INFO:teuthology.orchestra.run.smithi063.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 10:33 /home/ubuntu/cephtest 2024-09-18T10:33:47.693 INFO:teuthology.orchestra.run.smithi071.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 10:33 /home/ubuntu/cephtest 2024-09-18T10:33:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 10:33 /home/ubuntu/cephtest 2024-09-18T10:33:47.707 INFO:teuthology.orchestra.run.smithi160.stdout: 265628 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 18 10:33 /home/ubuntu/cephtest 2024-09-18T10:33:47.709 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T10:33:47.719 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T10:33:47.750 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} duration: 627.2756779193878 flavor: default owner: scheduled_skanta@teuthology success: true 2024-09-18T10:33:47.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T10:33:47.839 INFO:teuthology.run:pass